-- Logs begin at Tue 2022-03-08 12:26:03 UTC, end at Tue 2022-03-08 14:12:35 UTC. -- Mar 08 13:09:51.575361 dv-cinder-830091-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 13:09:51.584296 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 13:09:51 2022] *** Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: nodename: dv-cinder-830091-2-iscsi Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: machine: x86_64 Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: clock source: unix Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: pcre jit disabled Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: detected number of CPU cores: 4 Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: current working directory: / Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: detected binary path: /usr/bin/uwsgi-core Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: your processes number limit is 47680 Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: your memory page size is 4096 bytes Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: detected max file descriptor number: 2048 Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: lock engine: pthread robust mutexes Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: thunder lock: enabled Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 13:09:51.587164 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 13:09:51.632086 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: Python main interpreter initialized at 0x55efcaa5f9c0 Mar 08 13:09:51.632086 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: python threads support enabled Mar 08 13:09:51.632086 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: your server socket listen backlog is limited to 100 connections Mar 08 13:09:51.632086 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: your mercy for graceful operations on workers is 90 seconds Mar 08 13:09:51.632409 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 13:09:51.632487 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: *** Operational MODE: preforking *** Mar 08 13:09:51.632712 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: *** uWSGI is running in multiple interpreter mode *** Mar 08 13:09:51.632712 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: spawned uWSGI master process (pid: 102778) Mar 08 13:09:51.632909 dv-cinder-830091-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 13:09:51.633442 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: spawned uWSGI worker 1 (pid: 102779, cores: 1) Mar 08 13:09:51.633788 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: spawned uWSGI worker 2 (pid: 102780, cores: 1) Mar 08 13:09:51.633952 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 13:09:53.481186 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:09:53.481186 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: from cryptography.utils import int_from_bytes Mar 08 13:09:53.481803 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:09:53.481803 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: from cryptography.utils import int_from_bytes Mar 08 13:09:53.482244 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:09:53.482244 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: from cryptography.utils import int_from_bytes Mar 08 13:09:53.482370 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:09:53.482370 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: from cryptography.utils import int_from_bytes Mar 08 13:09:56.132725 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 13:09:56.133374 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 13:09:56.133461 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 13:09:56.133806 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 13:09:56.134060 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 13:09:56.134445 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.134770 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.135089 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.135406 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.135735 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.136041 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.136358 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.136698 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.137029 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.137288 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.137600 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.137869 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 13:09:56.138526 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-2-iscsi {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.138612 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 13:09:56.138689 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.138816 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.138931 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 13:09:56.139119 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.139296 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 13:09:56.139437 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.139591 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 13:09:56.139740 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.139986 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.140080 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.140312 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.140392 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.140637 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.140853 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.140965 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.141295 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.141418 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.141603 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.141710 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.141906 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.141999 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.142226 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.142327 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.142542 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.142646 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.142808 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.142929 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.143111 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.143197 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.143437 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-2-iscsi {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.143538 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.143757 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.143840 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.144064 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.144162 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.144376 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.144460 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-2-iscsi {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.144715 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.144835 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.145028 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.145129 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.145348 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.145432 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.145654 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.145767 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.146077 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.146159 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.146384 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.146531 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.146701 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.146789 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.147024 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.147108 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.147329 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.147422 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.147651 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.147744 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.147967 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.148060 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.148283 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.148368 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.148591 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.148709 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.148915 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.148998 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.149219 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.149304 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.149524 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.149608 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-2-iscsi {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.149838 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.149941 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.150141 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.150224 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.150443 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.150534 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.150690 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.150908 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.150992 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.151221 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.151310 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.151529 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.151613 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.151847 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.151932 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.152143 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.152234 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.152390 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.152476 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.152725 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.152824 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.153045 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.153142 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.153349 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.153451 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.153655 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.153751 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.153958 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.154054 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.154263 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.154366 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.154595 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.154731 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.154900 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.155063 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.155348 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.155443 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.155657 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.155756 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.155907 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.155998 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.156220 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.156308 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.156544 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.156648 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.156895 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.156995 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.157215 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.157305 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.157469 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.157608 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.157774 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.157872 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.158028 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.158151 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.158350 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.158486 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.158656 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.158807 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.158964 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.159114 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.159271 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.159429 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.159577 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.159746 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.159883 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.160051 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.160190 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.160357 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.160495 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.160692 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.160827 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.161000 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.161146 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.161332 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.161461 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.161637 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.161782 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.161876 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.162090 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.162178 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.162408 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.162495 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.162762 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.162848 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.163042 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.163183 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.163348 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.163432 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.163653 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.163746 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.163952 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.164046 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.164255 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.164339 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.164559 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.164643 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.164885 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.164981 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.165194 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.165301 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.165501 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.165611 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.165803 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.165905 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.166107 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.166204 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.166410 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.166516 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.166712 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.166853 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167021 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167164 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167302 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167444 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167587 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167727 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167860 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.167994 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.168127 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.168271 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.168418 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.168559 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.168748 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.168885 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.169051 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.169197 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.169357 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.169494 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.169664 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.169800 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.170507 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.170661 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.170816 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.170959 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.171119 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.171264 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.171422 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.171572 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.171726 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.171878 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.172031 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.172197 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.172336 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.172497 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.172667 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.172827 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.172994 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.173141 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.173283 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.173448 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.173591 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.173751 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.173895 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.174055 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.174202 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.174358 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.174522 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.174661 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.174828 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.174964 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.175133 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.175267 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.175452 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.175586 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.175758 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.175895 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.176069 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.176214 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.176387 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.176525 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.176724 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.176879 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.177036 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.177169 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.177354 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.177489 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.177653 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.177803 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.177966 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.178102 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.178263 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.178406 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.178570 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.178730 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.178866 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.178999 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.179168 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.179303 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.179472 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.179621 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.179777 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.179913 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.180082 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.180226 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.180369 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.180504 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.180701 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.180803 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.180987 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.181075 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.181306 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.181393 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.181626 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.181715 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.181932 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.182019 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.182236 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.182330 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.182542 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.182628 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.182860 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:09:56.182954 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.183172 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.183272 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.183491 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.183590 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.183804 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.183949 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.184109 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.184196 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.184431 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.184526 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.184767 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.184938 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.185079 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.185174 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.185400 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.185496 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.186328 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.186440 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.186643 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.186822 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.186967 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.187145 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.187283 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.187461 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.187594 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.187774 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.187907 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.188094 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.188216 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.188412 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.188536 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.188768 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.188892 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.189088 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.189203 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.189406 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.189517 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.189724 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.189812 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.190035 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.190130 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.190353 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.190442 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.190679 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.190766 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.190999 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.191098 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.191311 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.191405 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.191621 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.191708 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.191933 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.192029 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.192245 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.192332 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.192558 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.192645 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.192944 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.193062 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.193198 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.193287 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.193511 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.193627 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.193812 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.193926 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.194115 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.194204 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.194418 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.194503 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.194723 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.194816 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.195023 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.195108 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.195336 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.195419 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.195643 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.195730 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.195948 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.196032 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.196255 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.196338 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.196571 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.196684 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.196901 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.196986 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.197215 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.197394 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.197536 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.197673 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.197816 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.197952 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.198110 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.198256 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.198419 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.198556 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.198720 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.198858 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.199030 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.199189 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.199324 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.199458 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.199625 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.199770 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.199927 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.200071 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.200232 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.200368 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.200535 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.200686 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.200867 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.200971 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.201177 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.201280 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.201611 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.201698 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.201927 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.202037 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.202237 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.202331 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.202560 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.202647 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.202872 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.202961 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.203183 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.203269 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.203514 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.203614 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.203844 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.203943 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.204147 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.204246 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.204448 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.204533 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.204791 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.204882 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.205102 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.205187 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.205400 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.205504 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.205709 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.205821 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206006 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206095 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206305 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206407 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206604 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206745 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206907 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.206994 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.207207 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.207307 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.207506 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.207597 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.207810 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.207896 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.208109 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.208200 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.208407 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.208493 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.208744 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.208848 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.209051 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.209140 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.209351 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.209437 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.209648 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.209734 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.209945 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.210033 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.210281 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.210369 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.210583 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.210669 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.210888 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.210974 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.211198 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.211285 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.211502 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.211601 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.211804 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.211897 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.212109 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.212195 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.212416 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.212512 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.212742 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.212832 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.213048 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.213133 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.213350 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.213468 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.213655 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.213752 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.213958 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.214058 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.214261 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.214357 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.214572 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.214658 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.214874 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.214960 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.215175 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.215270 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.215474 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.215563 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.215791 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.215889 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.216094 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.216183 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.216433 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.216519 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.216806 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.216914 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.217173 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.217349 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.217490 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.217577 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.217802 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.217890 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.218109 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.218203 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.218416 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.218502 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.218722 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.218807 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.219029 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.219124 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.219334 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.219428 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.219642 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.219738 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.219950 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.220035 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.220255 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.220341 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.220563 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.220688 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.220891 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.220978 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.221206 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.221293 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.221508 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.221602 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.221820 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.221933 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.222121 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.222218 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.222431 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.222527 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.222755 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.222841 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.223074 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.223165 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.223378 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.223476 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.223685 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.223770 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.223994 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.224083 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.224304 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.224410 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.224608 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.224715 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.224943 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.225031 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.225248 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.225336 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.225550 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.225637 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.225859 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.225962 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.226171 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.226272 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.226477 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.226571 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.226780 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.226872 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.227081 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.227183 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.227389 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.227482 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.227690 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.227787 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.227987 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.228088 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.228283 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.228440 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.228576 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.228740 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.228917 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.229009 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.229224 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.229309 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.229542 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.229682 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.229850 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.229933 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.230150 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.230234 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.230452 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.230547 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.230752 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.230834 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.231055 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.231146 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.231360 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.231443 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.231664 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.231747 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.231966 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.232049 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.232273 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.232385 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.233142 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.233284 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.233443 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.233545 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.233752 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.233837 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.234060 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.234178 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.234378 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.234507 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.234672 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.234765 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.234981 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.235068 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.235288 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.235381 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.235608 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.235690 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.235918 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.236053 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.236224 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.236319 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.236533 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.236616 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.236862 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.236965 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.237169 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.237328 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.237477 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.237566 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.237785 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.237882 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.238086 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.238180 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.238391 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.238482 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.238698 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.238782 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.238999 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.239093 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.239304 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.239391 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.239619 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.239710 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.239929 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.240184 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.240269 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.240512 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.240596 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.240849 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.240949 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.241168 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.241253 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.241481 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.241564 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.241789 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.241883 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.242100 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.242184 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.242409 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.242500 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.242720 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.242806 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.243030 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.243113 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.243333 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.243427 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.243635 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.243727 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.243936 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.244021 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.244242 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.244325 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.244541 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.244637 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.244863 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.244951 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.245163 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.245248 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.245468 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.245739 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.245826 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.246055 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.246145 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.246368 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.246508 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.246692 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.246821 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.247012 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.247135 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.247330 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.247441 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.247659 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.247744 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.247987 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.248085 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.248433 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.248531 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.248767 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.248950 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.249078 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.249257 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.249386 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.249560 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.249690 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.249863 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.250002 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.250204 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.250295 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.250507 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.250610 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.250840 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.250925 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.251164 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.251257 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.251476 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.251567 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.251781 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.251864 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.252085 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.252169 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.252391 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.252485 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.252712 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.252798 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.253016 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.253100 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.253317 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.253404 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.253623 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.253705 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.253926 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.254010 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.254228 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.254314 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.254530 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.254612 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.254834 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.254929 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.255135 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.255220 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.255439 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.255530 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.255737 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.255821 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.256042 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.256127 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.256344 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.256430 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.256682 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.256783 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.256975 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.257066 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.257273 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.257358 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.257573 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.257669 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.257885 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.258013 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.258190 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.258274 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.258489 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.258583 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.258797 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.258881 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.259096 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.259182 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.259398 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.259490 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.259698 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.259781 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.259998 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.260089 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.260297 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.260384 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.260603 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.260706 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.260927 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.261011 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.261226 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.261313 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.261529 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.261612 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.261839 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.261922 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.262142 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.262228 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.262441 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.262524 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.262744 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.262827 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.263043 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.263135 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.263594 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.263687 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.264438 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.264574 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.264777 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.264981 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.265089 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.265298 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.265383 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.265602 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.265695 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.265911 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.265996 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.266214 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.266340 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.266516 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.266635 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.266818 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.266928 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.267299 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.267401 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.267490 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.267569 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.267712 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.267797 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.268010 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.268147 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.268311 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.268396 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.268615 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.268763 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.268944 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.269037 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.269247 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.269338 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.269545 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.269637 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.269847 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.269941 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.270145 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.270238 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.270455 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.270538 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.270766 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.270858 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.271068 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.271152 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.271372 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.271455 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.271674 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.271758 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.271981 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.272065 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.272284 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.272375 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.272586 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.272695 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.272912 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.272997 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.273214 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.273300 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.273517 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.273600 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.273821 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.273904 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.274131 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.274216 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.274432 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.274516 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.274731 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.274825 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.275029 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.275123 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.275344 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.275428 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.275652 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.275738 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.275970 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.276064 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.276288 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.276375 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.276602 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.276789 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.276924 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.277018 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.277230 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.277316 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.277539 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.277624 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.277846 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.277939 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.278148 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.278231 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.278456 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.278539 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.278761 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.278854 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.279068 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.279154 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.279420 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.279600 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.279735 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.279829 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.280043 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.280128 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.280344 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.280451 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.280650 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.280791 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.280975 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.281108 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.281275 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.281434 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.281593 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.281760 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.281900 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.282067 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.282200 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.282376 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.282504 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.282689 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.282803 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.282999 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.283107 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.283309 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.283395 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.283618 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.283814 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.283929 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.284125 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.284242 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.284433 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.284553 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.284762 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.284903 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.285072 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.285215 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.285379 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.285520 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.285692 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.285830 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.286004 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.286139 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.286308 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.286457 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.286723 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.286819 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.287029 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.287118 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.287336 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.287422 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.287641 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.287729 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.287940 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.288028 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.288243 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.288355 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.288543 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.288635 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.288885 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.289014 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.289186 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.289331 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.289488 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.289656 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.289787 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.289964 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.290103 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.290277 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.290403 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.290590 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.290719 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.290909 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.291127 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.291218 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.291435 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.291532 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.291735 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.291923 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.292142 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.292227 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.292448 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.292541 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.292780 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.292880 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.293101 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.293196 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.293418 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.293513 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.293732 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.293814 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.294030 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.294113 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.294339 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.294431 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.294641 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.294724 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.295550 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.295675 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.295854 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.295946 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.296093 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.296208 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.296403 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.296537 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.296742 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.296993 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.297080 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.297310 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.297395 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.297635 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.297773 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.297936 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.298030 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.298326 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.298456 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.298640 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.298725 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.298949 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.299044 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.299266 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.299352 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.299584 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.299670 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.299887 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.299972 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.300186 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.300281 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.300491 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.300577 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.300814 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.300905 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.301115 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.301200 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.301432 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.301526 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.301733 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.301827 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.302037 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.302121 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.302342 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.302426 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.302647 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.302734 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.302948 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.303033 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.303247 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.303342 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.303562 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.303678 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.303862 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.304003 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.304178 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.304315 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.304487 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.304637 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.304828 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.304986 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.305147 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.305292 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.305447 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.305601 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.305767 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.305910 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.306073 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.306213 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.306372 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.306515 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.306669 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.306843 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.306967 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.307148 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.307303 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.307457 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.307605 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.307768 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.307936 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.308077 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.308237 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.308381 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.308562 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.308702 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.308893 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.309028 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.309222 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.309331 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.309544 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.309653 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.309857 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.309967 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.310172 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.310289 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.310491 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.310710 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.310934 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.311073 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.311319 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.311450 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.311633 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.311776 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.311935 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.312069 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.312236 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.312378 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.312538 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.312722 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.312854 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.313006 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.313160 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.313295 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.313460 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.313603 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.313761 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.313892 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.314080 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.314215 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.314381 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.314524 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.314699 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.314846 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.314988 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.315130 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.315293 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.315428 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.315595 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.315753 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.315885 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.316019 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.316219 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.316316 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.316519 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.316609 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.316873 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.316952 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.317189 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.317266 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.317498 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.317579 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.317805 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.317892 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.318115 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.318190 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.318420 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.318494 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.318723 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.318807 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.319025 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.319100 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.320690 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.320804 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.320879 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.320965 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321037 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321117 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321187 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321260 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321328 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321408 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321479 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321545 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321611 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321677 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321750 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321819 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321893 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.321987 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.322095 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.322353 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.322515 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.322666 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.322814 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.322961 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.323103 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.323236 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.323378 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.323544 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.323680 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.323856 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.323990 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.324165 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.324313 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.324476 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.324613 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.324808 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.324896 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.325117 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.325205 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.325425 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.325512 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.325748 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.325836 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.326068 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.326174 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.326917 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.327017 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.327236 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.327347 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.327556 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.327664 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.327976 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.328101 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.328287 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.328428 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.328596 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.328771 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.328976 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.329080 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.329287 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.329423 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.329589 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.329675 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.329897 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.329982 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.330209 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.330296 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.330518 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.330603 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.330826 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.330912 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.331133 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.331220 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.331442 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.331527 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.331749 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.331834 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.332055 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.332142 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.332361 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.332453 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.332706 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.332818 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.332998 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.333085 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.333320 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.333412 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.333651 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.333750 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.333967 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.334055 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.334274 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.334367 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.334582 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.334680 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.334892 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.334978 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.335209 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.335408 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.335525 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.335719 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.335838 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.336048 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.336133 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.336368 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.336462 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.336712 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.336801 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.337026 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.337124 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.337340 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.337501 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.337661 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.337747 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.337964 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.338056 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.338265 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.338352 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.338572 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.338665 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.338882 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.338974 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.339187 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.339274 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.339509 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.339609 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.339815 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.339902 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.340114 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.340333 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.340419 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.340648 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.340766 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.341004 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.341262 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.341351 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.341612 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.341699 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.341986 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.342088 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.342317 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.342412 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.342647 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.342758 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.342955 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.343066 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.343264 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.343353 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.343570 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.343671 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.343883 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.343986 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.344186 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.344278 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.344499 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.344592 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.344829 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.344935 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.345130 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.345222 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.345431 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.345531 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.345743 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.345833 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.346055 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.346293 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.346390 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.346648 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.346756 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347410 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347485 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347552 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347618 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347692 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347766 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347833 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.347897 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.348123 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.348222 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.348432 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.348522 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.348761 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.348854 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.349066 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.349165 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.349368 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.349457 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.349673 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.349774 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.349977 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.350091 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.350278 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.350375 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.350583 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.350672 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.350885 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.350988 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.351192 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.351280 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.351492 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.351587 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.351791 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.351888 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.352117 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.352207 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.352423 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.352510 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.352752 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.352844 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.353055 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.353156 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.353366 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.353453 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.353671 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.353771 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.353975 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.354063 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.354280 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.354368 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.354584 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.354672 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.354893 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.354980 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.355196 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.355284 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.355507 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.355744 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.355835 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.356074 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.356162 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.356387 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.356477 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.356715 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.356806 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.357058 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.357145 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.357364 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.357463 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.357714 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.357816 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.358014 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.358204 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.358334 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.358526 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.358649 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.358842 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.358955 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.359169 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.359266 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.359482 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.359582 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.359797 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.359898 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.360142 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.360232 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.360449 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.360537 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.360776 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.361008 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.361110 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.361344 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.361433 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.361666 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.361762 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.361969 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.362066 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.362280 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.362369 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.362614 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.362702 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.362919 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.363007 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.363226 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.363315 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.363535 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.363623 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.363845 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.363942 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.364153 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.364242 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.364456 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.364544 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.364782 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.364875 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.365089 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.365179 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.365398 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.365486 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.365713 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.365814 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.366020 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.366107 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.366323 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.366490 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.366630 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.366726 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.366940 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.367030 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.367254 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.367352 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.367568 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.367657 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.367907 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.367996 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.368227 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.368317 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.368544 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.368632 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.368874 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.368965 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.369189 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.369277 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.369495 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.369586 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.369853 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.369953 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.370105 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.370195 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.370416 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.370504 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.370731 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.370845 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.371043 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.371140 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.371344 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.371434 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.371646 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.371748 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.371951 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.372053 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.372265 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.372353 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.372571 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.372700 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.372892 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.372981 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.373739 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.373981 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.374224 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.374327 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.374423 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.374622 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.374719 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.374922 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.375023 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.375223 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.375312 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.375527 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.375622 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.375829 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.375939 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.376126 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.376215 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.376425 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.376514 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.376750 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.376859 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.377052 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.377140 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.377351 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.377439 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.377655 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.377752 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.377953 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.378050 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.378253 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.378347 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.378551 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.378647 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.378855 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.378943 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.379154 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.379243 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.379482 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.379579 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.379784 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.379872 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.380091 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.380191 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.380392 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.380482 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.380716 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.380820 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.381029 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.381127 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.381333 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.381422 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.381637 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.381731 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.381939 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.382037 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.382241 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.382329 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.382544 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.382640 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.382894 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.383000 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.383157 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.383247 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.383456 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.383552 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.383759 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.383856 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.384058 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.384145 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.384360 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.384448 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.384699 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.384804 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.385006 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.385097 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.385328 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.385417 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.385631 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.385728 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.385955 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.386054 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.386264 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.386353 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.386578 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.386668 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.386887 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.386983 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.387193 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.387280 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.387513 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.387602 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.387820 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.387908 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.388126 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.388225 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.388750 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.388848 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.389115 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.389215 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.389396 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.389499 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.389708 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.389803 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.390019 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.390118 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.390345 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.390460 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.390663 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.390759 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.390982 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.391078 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.391301 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.391398 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.391608 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.391695 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.391934 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.392029 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.392250 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.392340 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.392568 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.392684 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.392923 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.393065 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.393208 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.393299 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.393512 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.393601 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.393753 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 13:09:56.393852 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.394127 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.394452 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.394748 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.395059 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.395374 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.395691 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.396020 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.396341 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.396680 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.397022 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.397370 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.397689 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.398035 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.398366 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.398682 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.398994 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.399302 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:09:56.399544 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 13:09:56.416939 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:56.422544 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:56.479264 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.context [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b93ebe6-7227-4cf2-85fc-4a30a39b2f72(cell1) {{(pid=102779) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 13:09:56.484234 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:09:56.484582 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.context [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b93ebe6-7227-4cf2-85fc-4a30a39b2f72(cell1) {{(pid=102780) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 13:09:56.485830 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:09:56.486625 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:09:56.488542 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:09:56.488730 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:09:56.490310 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:09:56.491116 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:09:56.493163 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:09:56.500377 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:56.503264 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:56.507284 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:56.509872 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:56.667478 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:56.670827 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:09:57.074783 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:09:57.081600 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:09:57.094222 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:09:57.100803 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:09:57.429744 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:09:57.434862 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:09:57.440167 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:09:57.440728 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efcaa5f9c0 pid: 102780 (default app) Mar 08 13:09:57.442758 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:09:57.443894 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001680 Mar 08 13:09:57.444299 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Mar 8 13:09:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:09:57.445463 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-f6441cd5-ba95-4688-a232-c9c18707182b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:09:57.450540 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55efcaa5f9c0 pid: 102779 (default app) Mar 08 13:11:22.591492 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:22.593496 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Mar 08 13:11:22.595597 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:23.017035 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-88bd4503-ede1-483f-adbc-f488b74c6c48 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:23.046068 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-88bd4503-ede1-483f-adbc-f488b74c6c48 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.445292 Mar 08 13:11:23.056719 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Mar 8 13:11:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:25.436435 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:25.438252 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-18721f2c-00e1-4202-8a40-2576324a3419 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Mar 08 13:11:25.438856 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:25.498759 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-a91a79ac-176d-4faa-9930-532987287c91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "vcpus": 1}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:25.517544 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:11:25.517544 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: warnings.warn(msg) Mar 08 13:11:25.612648 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-a91a79ac-176d-4faa-9930-532987287c91 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.168023 Mar 08 13:11:25.621295 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:11:25.848461 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-9882e6b3-3ccb-45d2-89b1-1083607dab5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:25.851053 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:11:25.851053 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: warnings.warn(msg) Mar 08 13:11:25.958758 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-9882e6b3-3ccb-45d2-89b1-1083607dab5a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.335856 Mar 08 13:11:25.959336 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Mar 8 13:11:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:28.349113 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-a91a79ac-176d-4faa-9930-532987287c91 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:28.350117 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-a91a79ac-176d-4faa-9930-532987287c91 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Mar 08 13:11:28.350534 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:28.462027 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-70cddc20-2c1f-4d5f-a2c7-a14b9591c167 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "name": "ds512M", "disk": 5, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:28.486170 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:11:28.486170 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: warnings.warn(msg) Mar 08 13:11:28.564189 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-70cddc20-2c1f-4d5f-a2c7-a14b9591c167 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.207736 Mar 08 13:11:28.564791 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:11:28.580275 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-b0f4a746-b8ac-4ce5-bde7-3bdf897f54bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:28.581869 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:11:28.581869 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: warnings.warn(msg) Mar 08 13:11:28.658242 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-b0f4a746-b8ac-4ce5-bde7-3bdf897f54bf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081265 Mar 08 13:11:28.659059 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Mar 8 13:11:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:31.045422 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-70cddc20-2c1f-4d5f-a2c7-a14b9591c167 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:31.046472 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-70cddc20-2c1f-4d5f-a2c7-a14b9591c167 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Mar 08 13:11:31.046914 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:31.120005 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-dc50b8d0-7cb6-492a-946b-e474ba23f2a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "disk": 10}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:31.214998 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-dc50b8d0-7cb6-492a-946b-e474ba23f2a2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160818 Mar 08 13:11:31.215753 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:11:31.227753 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-5b8cec47-80dd-40ac-991a-2802061f5796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:31.320628 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-5b8cec47-80dd-40ac-991a-2802061f5796 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096757 Mar 08 13:11:31.322294 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Mar 8 13:11:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:33.742076 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-dc50b8d0-7cb6-492a-946b-e474ba23f2a2 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:33.743663 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-dc50b8d0-7cb6-492a-946b-e474ba23f2a2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 Mar 08 13:11:33.744358 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:33.803510 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b0186a2a-3dec-4ea2-9878-0254936f4426 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:33.905919 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-b0186a2a-3dec-4ea2-9878-0254936f4426 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155944 Mar 08 13:11:33.906472 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:11:33.918722 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-89df4f5a-d105-4648-89a0-c3bd6d071265 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:33.995136 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-89df4f5a-d105-4648-89a0-c3bd6d071265 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080533 Mar 08 13:11:33.996067 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Mar 8 13:11:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:36.394872 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b0186a2a-3dec-4ea2-9878-0254936f4426 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:36.395872 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-b0186a2a-3dec-4ea2-9878-0254936f4426 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Mar 08 13:11:36.401181 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:36 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:36.457029 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-4c0fd15d-2c2c-4b7a-a577-f7068ed9e7d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "name": "ds4G", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:36.539956 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-4c0fd15d-2c2c-4b7a-a577-f7068ed9e7d3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136790 Mar 08 13:11:36.540644 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:11:36.553345 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-d4007ce2-be41-4eba-8952-c5e67562a4a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:36.640250 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-d4007ce2-be41-4eba-8952-c5e67562a4a5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090855 Mar 08 13:11:36.640862 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Tue Mar 8 13:11:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:39.021042 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-4c0fd15d-2c2c-4b7a-a577-f7068ed9e7d3 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:39.022137 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-4c0fd15d-2c2c-4b7a-a577-f7068ed9e7d3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Mar 08 13:11:39.022534 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:39.081995 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-04acfd6c-f6c3-4899-a8b6-a5850ffa88f1 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:39.105681 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-04acfd6c-f6c3-4899-a8b6-a5850ffa88f1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076954 Mar 08 13:11:39.106435 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Mar 8 13:11:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:11:41.982451 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-4c0fd15d-2c2c-4b7a-a577-f7068ed9e7d3 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:41.983758 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-4c0fd15d-2c2c-4b7a-a577-f7068ed9e7d3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Mar 08 13:11:41.984757 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:42.052643 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-bdfdda38-6c5f-4778-a9a5-538af09db571 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:42.134386 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-bdfdda38-6c5f-4778-a9a5-538af09db571 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.143875 Mar 08 13:11:42.135106 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:11:42.150808 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-be1a3fef-e344-43cd-8a06-24f1d8b69012 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:42.240578 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-be1a3fef-e344-43cd-8a06-24f1d8b69012 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097282 Mar 08 13:11:42.241302 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Mar 8 13:11:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:44.707380 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-bdfdda38-6c5f-4778-a9a5-538af09db571 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:44.708393 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-bdfdda38-6c5f-4778-a9a5-538af09db571 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Mar 08 13:11:44.708838 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:44.767757 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-cae5c4c7-b917-414f-a4a0-610ab0cd0ae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:44.847697 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-cae5c4c7-b917-414f-a4a0-610ab0cd0ae4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132279 Mar 08 13:11:44.848262 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:11:44.860004 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b3eba75c-7259-4184-bc33-45def90b5caf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:44.948739 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-b3eba75c-7259-4184-bc33-45def90b5caf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092331 Mar 08 13:11:44.949331 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Mar 8 13:11:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:47.380276 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-cae5c4c7-b917-414f-a4a0-610ab0cd0ae4 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:47.381356 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-cae5c4c7-b917-414f-a4a0-610ab0cd0ae4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Mar 08 13:11:47.381761 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:47.439988 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-fd83dd46-7c67-4870-833e-e9d262d9d691 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "ram": 4096}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:47.510768 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-fd83dd46-7c67-4870-833e-e9d262d9d691 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.122927 Mar 08 13:11:47.511320 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:11:47.523106 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-fd79f3c4-5925-4e99-9fbf-a90e693d9095 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:47.594043 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-fd79f3c4-5925-4e99-9fbf-a90e693d9095 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074584 Mar 08 13:11:47.594632 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Mar 8 13:11:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:49.987608 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-fd83dd46-7c67-4870-833e-e9d262d9d691 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:49.988611 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-fd83dd46-7c67-4870-833e-e9d262d9d691 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Mar 08 13:11:49.989045 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:50.055498 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-b01e55cc-441d-4562-be8b-fd81e900584f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "disk": 80, "vcpus": 4, "id": "4", "ram": 8192}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:50.122247 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-b01e55cc-441d-4562-be8b-fd81e900584f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.126618 Mar 08 13:11:50.124122 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:11:50.135320 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-4122c0f4-57c7-4bbd-a980-56780a3a2a00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:50.211526 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-4122c0f4-57c7-4bbd-a980-56780a3a2a00 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080637 Mar 08 13:11:50.212231 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Mar 8 13:11:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:11:52.616318 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-b01e55cc-441d-4562-be8b-fd81e900584f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:11:52.617401 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-b01e55cc-441d-4562-be8b-fd81e900584f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Mar 08 13:11:52.617801 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:11:52.683211 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-2d6d8ab5-3b69-480b-a758-7862468d7854 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "id": "5", "name": "m1.xlarge"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:52.773906 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-2d6d8ab5-3b69-480b-a758-7862468d7854 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.149854 Mar 08 13:11:52.774506 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Tue Mar 8 13:11:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:11:52.788550 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-80ae4eaf-59b0-419f-b21e-2a203554e509 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:11:52.868253 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-80ae4eaf-59b0-419f-b21e-2a203554e509 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085662 Mar 08 13:11:52.868799 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Tue Mar 8 13:11:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:12:16.783523 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-2d6d8ab5-3b69-480b-a758-7862468d7854 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:16.784558 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-2d6d8ab5-3b69-480b-a758-7862468d7854 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Mar 08 13:12:16.784998 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:12:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:16.841055 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-0b4dc03f-b3a7-4681-bff0-db62054774e6 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:16.857414 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-0b4dc03f-b3a7-4681-bff0-db62054774e6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066624 Mar 08 13:12:16.857937 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Mar 8 13:12:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:12:18.255561 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-2d6d8ab5-3b69-480b-a758-7862468d7854 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:18.256834 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-2d6d8ab5-3b69-480b-a758-7862468d7854 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Mar 08 13:12:18.259843 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:18.468612 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-6c426467-240c-4331-90b4-d59d872650e1 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:18.474251 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.wsgi [None req-6c426467-240c-4331-90b4-d59d872650e1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 13:12:18.474808 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-6c426467-240c-4331-90b4-d59d872650e1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:12:18.475582 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-6c426467-240c-4331-90b4-d59d872650e1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057763 Mar 08 13:12:18.476081 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Mar 8 13:12:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:18.486020 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-45d7148b-23d5-44c8-b8f8-e4236f0a556f admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:18.506123 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-45d7148b-23d5-44c8-b8f8-e4236f0a556f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023747 Mar 08 13:12:18.506923 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Mar 8 13:12:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:12:18.516393 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-bea24ac4-945b-4eb4-ad7f-7e3e40fba0b6 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:18.537525 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-bea24ac4-945b-4eb4-ad7f-7e3e40fba0b6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024667 Mar 08 13:12:18.538060 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Mar 8 13:12:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:12:18.547773 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-a0365c53-0e66-493f-aefc-9b98833f6479 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:18.553155 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.wsgi [None req-a0365c53-0e66-493f-aefc-9b98833f6479 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 13:12:18.553722 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-a0365c53-0e66-493f-aefc-9b98833f6479 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:12:18.554501 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-a0365c53-0e66-493f-aefc-9b98833f6479 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010294 Mar 08 13:12:18.555149 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Mar 8 13:12:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:19.873248 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-bea24ac4-945b-4eb4-ad7f-7e3e40fba0b6 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:19.874280 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-bea24ac4-945b-4eb4-ad7f-7e3e40fba0b6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Mar 08 13:12:19.874679 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:20.064651 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-c04f53b1-c087-486b-8226-ca42ca722f8b admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:20.070401 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.wsgi [None req-c04f53b1-c087-486b-8226-ca42ca722f8b admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 13:12:20.070980 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-c04f53b1-c087-486b-8226-ca42ca722f8b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:12:20.071776 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-c04f53b1-c087-486b-8226-ca42ca722f8b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059132 Mar 08 13:12:20.072282 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Mar 8 13:12:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:20.081483 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-a1c06f1e-1553-4ecd-ae5e-a5cb65d4fc45 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:20.098373 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-a1c06f1e-1553-4ecd-ae5e-a5cb65d4fc45 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017389 Mar 08 13:12:20.098373 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Mar 8 13:12:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:12:20.105755 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-4cd5cfdc-c252-4bdc-9bb6-695de70dbbbe admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:20.119846 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-4cd5cfdc-c252-4bdc-9bb6-695de70dbbbe admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017596 Mar 08 13:12:20.120384 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Mar 8 13:12:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:12:20.129659 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-895396a7-f182-466e-b6de-8d98258e3d5e admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:20.135225 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.wsgi [None req-895396a7-f182-466e-b6de-8d98258e3d5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 13:12:20.135772 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-895396a7-f182-466e-b6de-8d98258e3d5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:12:20.136759 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-895396a7-f182-466e-b6de-8d98258e3d5e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010421 Mar 08 13:12:20.137079 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Mar 8 13:12:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:21.408335 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-4cd5cfdc-c252-4bdc-9bb6-695de70dbbbe admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:21.409381 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-4cd5cfdc-c252-4bdc-9bb6-695de70dbbbe admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Mar 08 13:12:21.409772 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:21.598649 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-2286a529-4a3b-48a6-b541-2b64fe10aedf admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:21.603771 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.wsgi [None req-2286a529-4a3b-48a6-b541-2b64fe10aedf admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 13:12:21.604323 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-2286a529-4a3b-48a6-b541-2b64fe10aedf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:12:21.605134 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-2286a529-4a3b-48a6-b541-2b64fe10aedf admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058589 Mar 08 13:12:21.605639 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Mar 8 13:12:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:21.614796 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-6bf119de-d950-4fa3-86cd-48dfc3464b99 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:21.628635 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-6bf119de-d950-4fa3-86cd-48dfc3464b99 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017367 Mar 08 13:12:21.629170 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Mar 8 13:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:12:21.640949 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:21.653883 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018111 Mar 08 13:12:21.654423 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Mar 8 13:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:12:21.663633 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-0ef227d3-141a-4910-bcba-627b4c41c77a admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:21.668896 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.wsgi [None req-0ef227d3-141a-4910-bcba-627b4c41c77a admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 13:12:21.669453 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-0ef227d3-141a-4910-bcba-627b4c41c77a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:12:21.670227 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-0ef227d3-141a-4910-bcba-627b4c41c77a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010261 Mar 08 13:12:21.670713 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Mar 8 13:12:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 13:12:22.934746 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:22.935742 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Mar 08 13:12:22.936113 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:23.123428 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-2a72e463-153b-46e0-a2a9-03e962991ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:12:23.200200 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-2a72e463-153b-46e0-a2a9-03e962991ff8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.126808 Mar 08 13:12:23.200778 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Mar 8 13:12:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:12:24.469281 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:24.470266 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Mar 08 13:12:24.470658 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:24.659162 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-da5aef64-18e2-4d20-9516-677584d23632 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:12:24.730992 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-da5aef64-18e2-4d20-9516-677584d23632 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.122871 Mar 08 13:12:24.731492 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Mar 8 13:12:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:12:26.000411 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:26.001436 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Mar 08 13:12:26.001837 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:26.201703 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-197c6388-a42f-4738-bc82-b5b69edb920e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:12:26.290870 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-197c6388-a42f-4738-bc82-b5b69edb920e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.142025 Mar 08 13:12:26.291422 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Mar 8 13:12:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:12:27.570521 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:27.571507 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Mar 08 13:12:27.571899 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:27.772149 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-bda49dbe-65d7-4512-b2ec-929c975e0c94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:12:27.852491 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-bda49dbe-65d7-4512-b2ec-929c975e0c94 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.138495 Mar 08 13:12:27.853053 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Mar 8 13:12:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:12:29.686113 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:29.687097 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Mar 08 13:12:29.687491 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:12:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:12:29.877063 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-4143850a-8a4c-4dc0-8656-af92a1e304b6 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:12:29.899018 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-4143850a-8a4c-4dc0-8656-af92a1e304b6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074465 Mar 08 13:12:29.899479 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Mar 8 13:12:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:13:20.996588 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:13:21.005118 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-52e6a7dc-acf7-446f-8aa6-944ce8460c5f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Mar 08 13:13:21.005118 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Tue Mar 8 13:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:13:21.055145 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-e3364706-0a3e-422e-98da-39de345f1cca admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:13:21.074392 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-e3364706-0a3e-422e-98da-39de345f1cca admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070569 Mar 08 13:13:21.074923 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Tue Mar 8 13:13:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:13:21.096806 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-d5604015-00c2-4ca5-b159-df41c1f80b20 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:13:21.104959 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-d5604015-00c2-4ca5-b159-df41c1f80b20 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011687 Mar 08 13:13:21.105472 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Mar 8 13:13:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:13:21.118400 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-db9f5588-6c66-40ca-8256-53041201526b admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:13:21.125794 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-db9f5588-6c66-40ca-8256-53041201526b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010907 Mar 08 13:13:21.126310 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Mar 8 13:13:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:13:21.137753 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-8f376e51-e184-44a9-b0ef-e2be56981ef3 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:13:21.146580 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-8f376e51-e184-44a9-b0ef-e2be56981ef3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012244 Mar 08 13:13:21.147134 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Tue Mar 8 13:13:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:13:21.162770 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:13:21.170977 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013920 Mar 08 13:13:21.171603 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Tue Mar 8 13:13:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:15:02.536223 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-d8563ad9-3bd8-4389-a181-d680dd220655 tempest-verify_tempest_config-231601804 tempest-verify_tempest_config-231601804-project] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:15:02.538203 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-d8563ad9-3bd8-4389-a181-d680dd220655 tempest-verify_tempest_config-231601804 tempest-verify_tempest_config-231601804-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104728 Mar 08 13:15:02.538733 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 34/69] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Mar 8 13:15:02 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:16:44.303601 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:44.304745 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Mar 08 13:16:44.305223 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 36/70] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:16:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:16:44.570156 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-623db1a3-bf37-4c55-937e-6da0c6e106ff admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:44.572194 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:16:44.572194 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: warnings.warn(msg) Mar 08 13:16:44.573555 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-623db1a3-bf37-4c55-937e-6da0c6e106ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:44.574216 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-623db1a3-bf37-4c55-937e-6da0c6e106ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:44.575011 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-623db1a3-bf37-4c55-937e-6da0c6e106ff admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:44.575451 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-623db1a3-bf37-4c55-937e-6da0c6e106ff admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:44.613506 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-623db1a3-bf37-4c55-937e-6da0c6e106ff admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.165903 Mar 08 13:16:44.614257 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 35/71] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Mar 8 13:16:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:16:45.896457 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:45.897472 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Mar 08 13:16:45.897858 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 37/72] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:16:46.090382 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-40477700-b898-4546-9a7a-e9eec3ba0fd4 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:46.091556 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:16:46.091556 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: warnings.warn(msg) Mar 08 13:16:46.092763 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-40477700-b898-4546-9a7a-e9eec3ba0fd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:46.093203 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-40477700-b898-4546-9a7a-e9eec3ba0fd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:46.093977 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-40477700-b898-4546-9a7a-e9eec3ba0fd4 admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:46.094427 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-40477700-b898-4546-9a7a-e9eec3ba0fd4 admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:46.113633 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-40477700-b898-4546-9a7a-e9eec3ba0fd4 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074498 Mar 08 13:16:46.114101 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 36/73] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Mar 8 13:16:46 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:16:57.837733 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:57.838762 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Mar 08 13:16:57.839154 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 38/74] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:16:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:16:58.030242 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-7a51bccc-1f1d-4c19-8b56-ca14bf30ee25 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:58.031393 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:16:58.031393 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: warnings.warn(msg) Mar 08 13:16:58.032570 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-7a51bccc-1f1d-4c19-8b56-ca14bf30ee25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:58.033039 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-7a51bccc-1f1d-4c19-8b56-ca14bf30ee25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:58.033879 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-7a51bccc-1f1d-4c19-8b56-ca14bf30ee25 admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:58.034307 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-7a51bccc-1f1d-4c19-8b56-ca14bf30ee25 admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:58.059221 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-7a51bccc-1f1d-4c19-8b56-ca14bf30ee25 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079603 Mar 08 13:16:58.059704 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 37/75] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Mar 8 13:16:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:16:59.355857 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:59.356910 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ad07407a-67c0-4867-a88a-6814eb7f46fa admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Mar 08 13:16:59.357301 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 39/76] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Mar 8 13:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:16:59.547471 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-46d296f9-6fdf-4651-a9c2-53df26068f7a admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:16:59.548677 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:16:59.548677 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: warnings.warn(msg) Mar 08 13:16:59.549868 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-46d296f9-6fdf-4651-a9c2-53df26068f7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:59.550311 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-46d296f9-6fdf-4651-a9c2-53df26068f7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:59.551112 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-46d296f9-6fdf-4651-a9c2-53df26068f7a admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:16:59.551541 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-46d296f9-6fdf-4651-a9c2-53df26068f7a admin admin] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:16:59.573059 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-46d296f9-6fdf-4651-a9c2-53df26068f7a admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075257 Mar 08 13:16:59.573471 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 38/77] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Mar 8 13:16:59 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:18:00.850933 dv-cinder-830091-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 08 13:18:00.852049 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: Tue Mar 8 13:18:00 2022 - graceful shutdown triggered... Mar 08 13:18:00.852575 dv-cinder-830091-2-iscsi devstack@n-api.service[102779]: Gracefully killing worker 1 (pid: 102779)... Mar 08 13:18:00.852972 dv-cinder-830091-2-iscsi devstack@n-api.service[102780]: Gracefully killing worker 2 (pid: 102780)... Mar 08 13:18:01.852777 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: worker 1 buried after 1 seconds Mar 08 13:18:01.852777 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: worker 2 buried after 1 seconds Mar 08 13:18:01.852777 dv-cinder-830091-2-iscsi devstack@n-api.service[102778]: goodbye to uWSGI. Mar 08 13:18:01.854400 dv-cinder-830091-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 08 13:18:01.854979 dv-cinder-830091-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 08 13:18:01.858401 dv-cinder-830091-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 13:18:01.874118 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 13:18:01 2022] *** Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: nodename: dv-cinder-830091-2-iscsi Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: machine: x86_64 Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: clock source: unix Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: pcre jit disabled Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: detected number of CPU cores: 4 Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: current working directory: / Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: detected binary path: /usr/bin/uwsgi-core Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: your processes number limit is 47680 Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: your memory page size is 4096 bytes Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: detected max file descriptor number: 2048 Mar 08 13:18:01.888906 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: lock engine: pthread robust mutexes Mar 08 13:18:01.891230 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: thunder lock: enabled Mar 08 13:18:01.891230 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 13:18:01.891230 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 13:18:01.935279 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: Python main interpreter initialized at 0x55e64ea329c0 Mar 08 13:18:01.935279 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: python threads support enabled Mar 08 13:18:01.935279 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: your server socket listen backlog is limited to 100 connections Mar 08 13:18:01.935279 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: your mercy for graceful operations on workers is 90 seconds Mar 08 13:18:01.935731 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 13:18:01.935731 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: *** Operational MODE: preforking *** Mar 08 13:18:01.936498 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: *** uWSGI is running in multiple interpreter mode *** Mar 08 13:18:01.936498 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: spawned uWSGI master process (pid: 117262) Mar 08 13:18:01.936747 dv-cinder-830091-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 13:18:01.937507 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: spawned uWSGI worker 1 (pid: 117280, cores: 1) Mar 08 13:18:01.937861 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: spawned uWSGI worker 2 (pid: 117282, cores: 1) Mar 08 13:18:01.938408 dv-cinder-830091-2-iscsi devstack@n-api.service[117262]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 13:18:03.871053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:18:03.871053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: from cryptography.utils import int_from_bytes Mar 08 13:18:03.871763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:18:03.871763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: from cryptography.utils import int_from_bytes Mar 08 13:18:03.875990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:18:03.875990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: from cryptography.utils import int_from_bytes Mar 08 13:18:03.876530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:18:03.876530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: from cryptography.utils import int_from_bytes Mar 08 13:18:06.258913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 13:18:06.259493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 13:18:06.259586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 13:18:06.259586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 13:18:06.260027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 13:18:06.260027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 13:18:06.260178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 13:18:06.260512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 13:18:06.260613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 13:18:06.260705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 13:18:06.260777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.261060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.261200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.261393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.261501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.261733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.261865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.262049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.262161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.262385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.262512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.262701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.262809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.263034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.263155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.263356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.263463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.263611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.264275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.264477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.264648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.264894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.265048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-2-iscsi {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.265228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-2-iscsi {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.265396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.265548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.265698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.265846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.265991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.266164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.266330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.266481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.266627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.266809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.266957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.267098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.267251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.267403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.267581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.269098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.269353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.269573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.269805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.270019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.270233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.271931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.272119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.272295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.272454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.272606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.272793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.272946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.273121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.273268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.273417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.273578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.273723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.273874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.274029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.274182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.274324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-2-iscsi {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.274474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-2-iscsi {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.274624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.274775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.274926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.275076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.275231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.275381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.275545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.275695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.276240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.276404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.276565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.276750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.276910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.277054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.277195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.277346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.277499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.277651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.277816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.277960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.278108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.278258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.278400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.278553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.278706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.278855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.278998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.279148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.279300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.280055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.280208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.280368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.280519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.280687 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.280847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.281004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.281154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.281295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.281442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.281591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.281746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.281888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.282035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.282191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.282356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.282506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.282664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.282818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.282964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.283107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.283249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.283419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.283579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.283728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.283889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.284043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.284204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.284347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.284496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.284644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.284853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.285004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.285155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.285309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.285457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.285598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.285749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.285900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.286073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.286488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.286710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.286863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.286863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.287141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.287284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.287426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.287567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.287708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.287856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.288021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.288164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.288305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.288447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.288587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.288750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.288905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.289047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.289187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.289339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.289490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.289640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.289796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.289958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.290109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.290259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.290409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.290566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.290708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.290869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.291017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.291159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.291312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.291454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.291658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.291803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.291961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.292119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.292273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.292415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.292566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.292769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.293046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.293211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.293366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.293663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.293820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.293970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.294119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.294275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.294425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.294566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.294707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.294855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.295038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.295201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.295357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.295508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.295656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.295799 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.295949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.296114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.296263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.296671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.296827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.296979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.297129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.297353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.297505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.297655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.297803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.297957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.298108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.298259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.298418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.298561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.298702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.298856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.299009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.299159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.299517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.299689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.299689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.299978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.300132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.300283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.300424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.300575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.300788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.300942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.301091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.301241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.301392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.301534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.301682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.301830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.301985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.302146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.302288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.302429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.302656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.302801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.302952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.303094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.303244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.303393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.303542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.303772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.303935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.304088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.304237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.304379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.304519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.304519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.304843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.304995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.305144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.305286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.305426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.305581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.305723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.305870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.306018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.306168 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.306311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.306471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.306845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.307001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.307144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.307286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.307437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.307630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.307781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.308005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.308150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.308297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.308448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.308598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.308782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.308936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.309080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.309220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.309376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.309518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.309667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:18:06.309815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.309963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.310104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.310311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.310472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.310652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.310808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.310959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.311112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.311315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.311491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.311644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.311787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.312054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.312233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.312379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.312541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.312813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.312980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.313131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.313284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.313436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.313580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.313720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.313960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.314115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.314267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.314410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.314551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.314705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.314861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.315021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.315178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.315329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.315479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.315631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.315781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.315931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.316080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.316080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.322221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.322409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.322604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.322773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.322931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.323096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.323252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.323398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.323548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.323691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.323841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.324090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.324249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.324404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.324557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.324731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.324913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.325065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.325218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.325360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.325501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.325649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.325841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.325985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.326127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.326820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.327281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.327592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.328850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.329010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.329164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.329324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.329475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.329618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.329758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.329907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.330050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.330200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.330345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.330488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.330628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.330787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.330930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.331080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.331234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.331379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.331528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.331669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.331819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.331969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.332122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.332271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.332412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.332575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.332816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.332964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.333113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.333254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.333395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.333537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.333691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.333853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.334002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.334247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.334397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.334546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.334767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.334930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.335081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.335223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.335364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.335513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.335670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.335819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.335973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.336121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.336264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.336419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.336561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.336731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.336878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.337030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.337030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.337579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.337724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.337866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.337866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.338147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.338147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.338424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.338566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.338707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.338707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.339004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.339004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.339388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.339536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.339677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.340058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.340205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.340357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.340498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.340643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.340867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.341010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.341478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.341724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.342101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.342481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.348243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.349093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.349345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.349345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.349639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.349785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.349935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.350080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.350244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.350396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.350546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.350695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.350844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.351005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.351154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.351299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.351440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.351581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.351735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.351735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.352037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.352188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.352330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.352472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.352620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.352807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.352951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.353092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.353240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.353389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.353548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.353702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.353853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.354007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.354156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.354324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.355923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.356951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.357046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.357140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.357235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.357235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.357389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.358956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.359971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.360063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.360148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.360230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.360564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.360807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.360900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.360981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.361935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.362989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.363962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364827 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.364999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.365927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.366980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.367975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.368925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.369999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.370973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.371958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.372591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.373994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.374999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.375962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.376976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.377938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.378073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.378245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.378346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.378555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.378657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.378866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.378957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.379217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.379300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.379529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.379612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.379875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.379981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.380193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.380293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.380525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.380626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.380865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.380952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.381175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.381263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.381874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.381960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.382039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.382116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.382194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.382274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.382662 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.382762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.383931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.384173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.384278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.384483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.384567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.384815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.384913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.385139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.385246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.385463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.385562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.385737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.385836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.386048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.386139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.386360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.386454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.386713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.386808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.386968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.387071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.387275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.387375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.387589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.387690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.387894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.387998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.388200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.388290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.388503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.388608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.389377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.389494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.389686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.389827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.389994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.390097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.390312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.390412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.390625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.390723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.390931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.391036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.391234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.391334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.391548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.391640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.391858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.391960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.392165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.392264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.392475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.392566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.392807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.392914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.393194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.393318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.393429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.393519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.393744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.393837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.394052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.394159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.394365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.394470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.394671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.394777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.394978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.395071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.395280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.395382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.395587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.395680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.395890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.395991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.396197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.396297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.396498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.396589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.396831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.396926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.397143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.397245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.397456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.397548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.397813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.397937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.398143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.398286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.398492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.398669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.398949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.399316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.399579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.399694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.399888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.399988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.400219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.400320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.400533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.400637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.400870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.400961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.401191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.401286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.401501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.401596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.401824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.401926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.402144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.402273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.402497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.402593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.402768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.402920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.403072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.403244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.403399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.403530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.403716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.403840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.404033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.404165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.404455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.404570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.404976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.405097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.405354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.405567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.405662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.405990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.406298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.406392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.406514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.406721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.406977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.407073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.407303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.407399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.407631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.407745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.407953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.408071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.408277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.408386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.408592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.408731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.408939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.409021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.409259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.409350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.409575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.409674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.409891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.409991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.410209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.410301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.410525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.410624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.410832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.410923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.411149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.411241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.411467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.411573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.411778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.411876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.412091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.412190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.412404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.412496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.412741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.412837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.413064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.413167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.413389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.413504 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.413696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.413825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.414013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.414145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.414457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.414549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.414776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.414867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.415090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.415191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.415399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.415501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.415716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.415813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.416028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.416140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.416349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.416440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.416690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.416787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.417008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.417103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.417400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.417499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.417711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.417811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.418018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.418120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.418334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.418438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.418650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.418747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.418958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.419057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.419266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.419367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.419574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.419674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.419894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.420520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.420805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.420922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.421124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.421356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.421453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.421750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.421846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.422081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.422184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.422391 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.422513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.422815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.422916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.423132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.423223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.423448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.423575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.423783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.423884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.424115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.424197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.424447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.424541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.424802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.424914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.425124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.425231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.425442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.425545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.425769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.425863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.426089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.426188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.426402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.426501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.426723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.426823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.427035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.427135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.427353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.427444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.427666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.427768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.427991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.428081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.428320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.428420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.428652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.428785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.429101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.429206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.429438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.429537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430227 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.430794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.431024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.431114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.431331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.431429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.431650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.431741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.431964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.432046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.432278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.432361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.432590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.432727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.432935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.433020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.433248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.433330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.433606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.433710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.433857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.433948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.434164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.434260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.434476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.434566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.434798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.434895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.435105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.435195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.435433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.435525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.435807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.435949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.436145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.436269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.436460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.436602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.436883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.436977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.437144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.437238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.437479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.437658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.437784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.437968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.438097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.438368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.438453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.438679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.438760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.439003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.439106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.439344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.439426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.439682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.439764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.439993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.440151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.440325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.440406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.440952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.441101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.441196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.441441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.441631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.441776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.441870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.442104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.442212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.442417 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.442507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.442732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.442832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.443039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.443138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.443347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.443441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.443667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.443768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.443961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.444065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.444285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.444418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.444615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.444799 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.444965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.456449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.456572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.456685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.456778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.456891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.457753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.458647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.458741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.458839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.458913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.459007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.459095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.459179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.459296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.459383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.459455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.459553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.460789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.460896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.460994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.461941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.462906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.463989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.464952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.465867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.466752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.467407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.467540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.467540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.467753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.467753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.467928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.468966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.469991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.470986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.471954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.472975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.473975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.474864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.475025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.475231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.475361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.475592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.475695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.475918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.476013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.476250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.476343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.476585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.476752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.476936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.477032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.477250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.477345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.477574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.477667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.477882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.477975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.478191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.478285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.478504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.478610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.478821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.478914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.479131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.479228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.479437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.479548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.479749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.479841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.480056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.480148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.480360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.480504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.480688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.480786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.481002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.481100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.481309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.481411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.481627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.481719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.481933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.482033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.482232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.482327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.482634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.482730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.483070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.483219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.483423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.483566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.483766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.483866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.484064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.484204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.484425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.484532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.484771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.484882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.485050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.485618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.485937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.486245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.486558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.486914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.487456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.487810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.488159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.488337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.488496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.488700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.488906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.489045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.489376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.489471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.489717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.489813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.490050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.490156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.490369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.490487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.490701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.490857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.491025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.491138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.491365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.491466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.491708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.491914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.492257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.492358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.492585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.492701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.493644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.493794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.493906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.493995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.494991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.495129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.495316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.495446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.495640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.495763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.495963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.496078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.496285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.496386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.496607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.496852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.496999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.497182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.497284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.497583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.497683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.497904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.498008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.498749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.498851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.499077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.499311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.499418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.499649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.499750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.499980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.500080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.500337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.500440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.500670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.500765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.501009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.501141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.501328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.501437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.501643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.501737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.501959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.502059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.502273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.502363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.502591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.502682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.502911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.503011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.503223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.503324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.503533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.503626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.503871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.503972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.504187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.504281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.504570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.504729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.504923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.505054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.505240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.505333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.505569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.505662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.505899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.506006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.506214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.506307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.506538 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.506632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.506855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.506956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.507186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.507279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.507507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.507608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.507845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.507949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.508177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.508278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.508489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.508581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.508877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.509017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.509189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.509290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.509496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.509588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.509813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.509913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.510126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.510219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.510435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.510529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.510743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.510837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.511056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.511186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.511364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.511475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.511673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.511768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.511982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.512074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.512289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.512401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.512597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.512708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.512926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.513031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.513234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.513337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.513542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.513692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.513927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.514022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.514238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.514340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.514546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.514639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.514860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.514953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.515169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.515265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.515476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.515607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.515784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.515880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.516092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.516193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.516398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.516492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.516848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.516955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.517173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.517286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.517516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.517636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.517862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.517996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.518941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.519928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.520794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.521029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.521142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.521254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.521366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.521476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.521627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.521748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.522098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.522418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.522738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.523056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.523395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.523731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.524045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.524380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.524745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.524961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.525084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.525346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.525448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.525691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.525803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.526027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.526175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.526405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.526765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.526954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.527109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.527289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.527457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.527607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.527795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.527952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.528123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.528288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.528470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.528573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.528873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.528981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.529207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.529829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.530097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.532680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.532811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.532904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.533941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.534027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.534027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.534027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117280) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 13:18:06.534521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.535040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.535391 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.535768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.536125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.536464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.536825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.537155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:18:06.537416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 13:18:06.556203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:06.560168 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:06.623995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.context [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b93ebe6-7227-4cf2-85fc-4a30a39b2f72(cell1) {{(pid=117280) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 13:18:06.628308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:06.629955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:18:06.630778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:06.632795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:18:06.634815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.context [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b93ebe6-7227-4cf2-85fc-4a30a39b2f72(cell1) {{(pid=117282) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 13:18:06.639154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:06.640808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:18:06.641656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:06.643661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:18:06.644288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:06.648295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:06.656434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:06.658188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:06.815330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_db.sqlalchemy.engines [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117280) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:06.822308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_db.sqlalchemy.engines [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:18:07.253898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: WARNING keystonemiddleware.auth_token [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:18:07.261099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: WARNING keystonemiddleware.auth_token [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:18:07.269501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: WARNING keystonemiddleware.auth_token [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:18:07.276150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: WARNING keystonemiddleware.auth_token [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:18:07.493501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: WARNING keystonemiddleware.auth_token [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:18:07.499519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: WARNING keystonemiddleware.auth_token [None req-9cf0021b-a2a5-4f0a-b7b9-d9326dc1ccd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:18:07.505124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e64ea329c0 pid: 117280 (default app) Mar 08 13:18:07.508477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: WARNING keystonemiddleware.auth_token [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 13:18:07.514313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: WARNING keystonemiddleware.auth_token [None req-d2e51bcb-1f4f-41db-9580-e9dd05421275 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 13:18:07.519835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e64ea329c0 pid: 117282 (default app) Mar 08 13:18:48.928057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e99957a-0925-4ec5-b641-355cc543b183 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Action: 'create', calling method: .version_select at 0x7f5e2f280c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-843746084", "metadata": {"Type": "work"}}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:18:48.929824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e99957a-0925-4ec5-b641-355cc543b183 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:18:48.931028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6e99957a-0925-4ec5-b641-355cc543b183 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.944429 Mar 08 13:18:48.933521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Mar 8 13:18:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 947 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 13:18:49.154451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-498eb717-23ee-4a17-8cae-2c4d005f3c3b tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Action: 'create', calling method: .version_select at 0x7f5e2f344940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1304624341", "metadata": {"Type": "work"}}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:18:49.156227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-498eb717-23ee-4a17-8cae-2c4d005f3c3b tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:18:49.157178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-498eb717-23ee-4a17-8cae-2c4d005f3c3b tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.218551 Mar 08 13:18:49.158069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1/2] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Mar 8 13:18:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:18:49.167709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e3976369-85f7-45ac-b369-0fdd2da0f6d7 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Action: 'create', calling method: .version_select at 0x7f5e2f1699d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-833282011", "metadata": {"Type": "work"}}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:18:49.175772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e3976369-85f7-45ac-b369-0fdd2da0f6d7 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:18:49.175772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e3976369-85f7-45ac-b369-0fdd2da0f6d7 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007966 Mar 08 13:18:49.175772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Mar 8 13:18:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 13:18:49.183965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e859672-b934-49f1-a666-56c8c1be669e tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Calling method '.version_select at 0x7f5e2f2395e0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:18:50.134001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-8e859672-b934-49f1-a666-56c8c1be669e tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] HTTP exception thrown: Volume tempest-invalid-296179828 could not be found. Mar 08 13:18:50.135282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e859672-b934-49f1-a666-56c8c1be669e tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Returning 404 to user: Volume tempest-invalid-296179828 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:18:50.136532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8e859672-b934-49f1-a666-56c8c1be669e tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-296179828" status: 404 len: 98 microversion: 2.1 time: 0.956839 Mar 08 13:18:50.141935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1214 bytes} [Tue Mar 8 13:18:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-296179828 => generated 98 bytes in 963 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 08 13:18:50.146688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c20934dc-9776-42b4-ae54-9a9b0565507a tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003723 Mar 08 13:18:50.147957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Mar 8 13:18:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 13:18:50.173130 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0e46079f-d2e0-400f-b117-6596ccf82758 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014951 Mar 08 13:18:50.175163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 3/6] 10.222.0.52 () {58 vars in 1136 bytes} [Tue Mar 8 13:18:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 13:18:50.194073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62f97444-ac6c-434f-bbb0-46faf11062b6 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Calling method '.version_select at 0x7f5e2f169940>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:18:50.743630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-62f97444-ac6c-434f-bbb0-46faf11062b6 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] HTTP exception thrown: Volume e572925a-2db1-4b6b-9eba-35de3ce92d40 could not be found. Mar 08 13:18:50.744991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62f97444-ac6c-434f-bbb0-46faf11062b6 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Returning 404 to user: Volume e572925a-2db1-4b6b-9eba-35de3ce92d40 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:18:50.746828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-62f97444-ac6c-434f-bbb0-46faf11062b6 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/e572925a-2db1-4b6b-9eba-35de3ce92d40" status: 404 len: 109 microversion: 2.1 time: 0.568033 Mar 08 13:18:50.747402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:18:50 2022] DELETE /compute/v2.1/os-volumes/e572925a-2db1-4b6b-9eba-35de3ce92d40 => generated 109 bytes in 569 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:18:50.757191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2cfaadf4-d576-4167-a419-ac436633c3f9 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Calling method '.version_select at 0x7f5e2f0e53a0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:18:50.810998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-2cfaadf4-d576-4167-a419-ac436633c3f9 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] HTTP exception thrown: Volume bf8db60b-ffb9-4da4-b937-011c39b2439f could not be found. Mar 08 13:18:50.811807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2cfaadf4-d576-4167-a419-ac436633c3f9 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] Returning 404 to user: Volume bf8db60b-ffb9-4da4-b937-011c39b2439f could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:18:50.812923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2cfaadf4-d576-4167-a419-ac436633c3f9 tempest-VolumesNegativeTest-1179352578 tempest-VolumesNegativeTest-1179352578-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/bf8db60b-ffb9-4da4-b937-011c39b2439f" status: 404 len: 109 microversion: 2.1 time: 0.059730 Mar 08 13:18:50.814204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:18:50 2022] GET /compute/v2.1/os-volumes/bf8db60b-ffb9-4da4-b937-011c39b2439f => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:18:52.017192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1377851719", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "networks": [{"uuid": "37ebb63b-609e-4ee9-a3fd-6ae6e72d96e4"}]}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:18:52.226430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] validate_networks() for [('37ebb63b-609e-4ee9-a3fd-6ae6e72d96e4', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:18:54.994214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:18:54.995540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:18:54.996031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:18:54.996454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:18:55.002657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:18:55.029217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:55.029672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:18:55.030483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:55.030918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:18:55.120081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Getting quotas for project 30ef500d9ef3421eb59d9ce08761298d. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:18:55.127072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Getting quotas for user 8eefbc5ad0b94a8db2878c8e45a2a3e8 and project 30ef500d9ef3421eb59d9ce08761298d. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:18:55.157725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:18:55.161096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:18:55.438061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dba6d73e-1b9d-4e8f-9506-f73a1e39f8a8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.706254 Mar 08 13:18:55.439265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 5/9] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:18:55.454152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e915a63c-e59e-488a-b322-2218c284d314 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:18:55.455026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e915a63c-e59e-488a-b322-2218c284d314 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:18:55.677452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e915a63c-e59e-488a-b322-2218c284d314 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:18:55.708210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e915a63c-e59e-488a-b322-2218c284d314 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1215 microversion: 2.1 time: 0.262772 Mar 08 13:18:55.713652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 5/10] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:18:55 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:18:56.741864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5ec4a9d3-0dec-4bd1-a0d1-4fa4518edd73 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:18:56.743119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5ec4a9d3-0dec-4bd1-a0d1-4fa4518edd73 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:18:57.173199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5ec4a9d3-0dec-4bd1-a0d1-4fa4518edd73 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:18:57.196732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5ec4a9d3-0dec-4bd1-a0d1-4fa4518edd73 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1215 microversion: 2.1 time: 0.462490 Mar 08 13:18:57.197786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 6/11] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:18:56 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1215 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:18:58.214472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f828ce9-0b3c-494a-ace1-ab01a73ce880 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:18:58.216268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f828ce9-0b3c-494a-ace1-ab01a73ce880 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:18:58.916911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f828ce9-0b3c-494a-ace1-ab01a73ce880 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:18:58.933371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f828ce9-0b3c-494a-ace1-ab01a73ce880 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1215 microversion: 2.1 time: 0.723266 Mar 08 13:18:58.943347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:18:58 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1215 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:18:59.952248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:18:59.953656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:18:59.965160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:59.967883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:18:59.982977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:18:59.985710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:00.545059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:00.574975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-827f1866-b3f5-4959-9c70-7ce2a23b5786 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1219 microversion: 2.1 time: 0.628272 Mar 08 13:19:00.582076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:18:59 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1219 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:01.269709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2085811932", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:01.502122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.network.neutron [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] validate_networks() for [('0831be40-b028-4650-82fd-64fffb3eb244', None, None, None, None, None)] {{(pid=117282) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:19:01.601692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:01.602314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:01.614144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:01.617535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:01.620124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:01.621252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:01.815184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:01.846644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8f960136-cbdb-411e-b437-34975521dc1b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1267 microversion: 2.1 time: 0.248941 Mar 08 13:19:01.847238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 8/14] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:01 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:02.528350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0f64371e-abef-4bf0-bdab-e3ce9949eb4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: .version_select at 0x7f5e2dee2550>, body: {"keypair": {"name": "tempest-keypair-585172195"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:02.583330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0f64371e-abef-4bf0-bdab-e3ce9949eb4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:02.593456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0f64371e-abef-4bf0-bdab-e3ce9949eb4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:03.104011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0f64371e-abef-4bf0-bdab-e3ce9949eb4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:03.123600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0f64371e-abef-4bf0-bdab-e3ce9949eb4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:03.169528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0f64371e-abef-4bf0-bdab-e3ce9949eb4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.321139 Mar 08 13:19:03.173988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 9/15] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:19:01 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:03.191075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:03.191970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:03.215443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:03.226419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:03.230240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:03.237763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:03.372592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:03.393513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3424bc9b-7143-479a-8edd-11b11454d9aa tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1273 microversion: 2.1 time: 0.216526 Mar 08 13:19:03.401575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 10/16] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:03 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:04.422565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:04.423218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:04.457768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:04.467112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:04.468025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:04.468482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:04.735685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:04.747950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a5a3210-a648-4168-ad77-a0961a143ef9 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1273 microversion: 2.1 time: 0.329318 Mar 08 13:19:04.749760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 11/17] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:04 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:05.147981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-094d0b1d-e3c5-43e5-ad6e-4b220dec1117 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'create', calling method: .version_select at 0x7f5e2dfa3af0>, body: {"keypair": {"name": "tempest-keypair-1216902503"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:05.210691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-094d0b1d-e3c5-43e5-ad6e-4b220dec1117 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:05.230585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-094d0b1d-e3c5-43e5-ad6e-4b220dec1117 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for user ced48ea897124de6b874e797b6d74f3d and project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:05.690747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Flavor limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:19:05.691285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Image limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:19:05.691723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Flavor pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:19:05.692648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Image pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:19:05.693483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:19:05.766539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:05.772642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:05.777038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:05.780957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:05.787886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-094d0b1d-e3c5-43e5-ad6e-4b220dec1117 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:05.793644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-094d0b1d-e3c5-43e5-ad6e-4b220dec1117 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for user ced48ea897124de6b874e797b6d74f3d and project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:05.813459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-094d0b1d-e3c5-43e5-ad6e-4b220dec1117 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.062408 Mar 08 13:19:05.814482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 12/18] 10.222.0.52 () {62 vars in 1198 bytes} [Tue Mar 8 13:19:04 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1064 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 13:19:05.829307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:05.830237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:05.846171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:05.847036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:05.849547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:05.851174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:05.994244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Getting quotas for project e18e69f500fe484994f99d9e8b599b78. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:06.023878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Getting quotas for user 658d1271fb264cb59e62a921492457c2 and project e18e69f500fe484994f99d9e8b599b78. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:06.047583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Going to run 1 instances... {{(pid=117282) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:19:06.053159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:19:06.321786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:06.321786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a9561b60-bdd7-4681-aa52-0bab129ba591 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.468604 Mar 08 13:19:06.321786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 13/19] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:05 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:06.730948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8521ff68-8bc8-4000-8d02-780f5b6c4959 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.804354 Mar 08 13:19:06.732552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 7/20] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:19:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 5807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:19:06.742926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b7a04198-eb77-4c61-93e9-2afd69fe611b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:06.743661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b7a04198-eb77-4c61-93e9-2afd69fe611b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:07.120063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b7a04198-eb77-4c61-93e9-2afd69fe611b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:07.129077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b7a04198-eb77-4c61-93e9-2afd69fe611b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1222 microversion: 2.1 time: 0.390132 Mar 08 13:19:07.148843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 14/21] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1222 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:07.336192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:07.339641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:07.382140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:07.382140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:07.385483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:07.388306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:07.579410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1789006107", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:07.749724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] validate_networks() for [('0831be40-b028-4650-82fd-64fffb3eb244', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:19:09.189665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:09.236866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ce1a8215-3579-4ea4-9825-2cdf98a43464 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 1.901047 Mar 08 13:19:09.238433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 8/22] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:07 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:09.513656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:19:09.514194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:19:09.514587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:19:09.515003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:19:09.515618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:19:09.559689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:09.570546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:09.572293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:09.573773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:09.633197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Getting quotas for project e18e69f500fe484994f99d9e8b599b78. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:09.661214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Getting quotas for user 658d1271fb264cb59e62a921492457c2 and project e18e69f500fe484994f99d9e8b599b78. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:09.688551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:19:09.701142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:19:09.906081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42c2c8d9-d74a-4cdf-98b0-442983baa2b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.332613 Mar 08 13:19:09.908558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 15/23] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:19:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:19:09.920271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8561fdf1-4f9d-4e22-9303-0c2aab6bda16 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:09.921535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8561fdf1-4f9d-4e22-9303-0c2aab6bda16 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:10.160009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8561fdf1-4f9d-4e22-9303-0c2aab6bda16 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:10.167610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8561fdf1-4f9d-4e22-9303-0c2aab6bda16 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1222 microversion: 2.1 time: 0.252991 Mar 08 13:19:10.170994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 9/24] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:09 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1222 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:10.265839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:10.265839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:10.303343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:10.303802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:10.307425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:10.309041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:10.867600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:10.892896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-476c466d-7f33-4032-98df-3e6b5111ef0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.641231 Mar 08 13:19:10.917057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 16/25] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:10 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:11.186959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3370e082-d26b-4524-9202-b83265c4322e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:11.187726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3370e082-d26b-4524-9202-b83265c4322e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:11.300114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3370e082-d26b-4524-9202-b83265c4322e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:11.340553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3370e082-d26b-4524-9202-b83265c4322e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1222 microversion: 2.1 time: 0.157366 Mar 08 13:19:11.343885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 17/26] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:11 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:11.783461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-e03ebfe6-6ba8-4d87-beb5-18b1a54b7c5a req-6f3fe615-8c70-4bd7-89ba-ca475b687d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13664093-145a-4f1d-9ed3-cc61a73ed00b", "tag": "103e07a3-2988-48cc-8dc9-f04152af20ec"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:11.837508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-e03ebfe6-6ba8-4d87-beb5-18b1a54b7c5a req-6f3fe615-8c70-4bd7-89ba-ca475b687d7f service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:11.845582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-e03ebfe6-6ba8-4d87-beb5-18b1a54b7c5a req-6f3fe615-8c70-4bd7-89ba-ca475b687d7f service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:11.923872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-e03ebfe6-6ba8-4d87-beb5-18b1a54b7c5a req-6f3fe615-8c70-4bd7-89ba-ca475b687d7f service nova] Creating event network-changed:103e07a3-2988-48cc-8dc9-f04152af20ec for instance 13664093-145a-4f1d-9ed3-cc61a73ed00b on hv-cinder-83009 Mar 08 13:19:11.924616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-e03ebfe6-6ba8-4d87-beb5-18b1a54b7c5a req-6f3fe615-8c70-4bd7-89ba-ca475b687d7f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117282) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 13:19:11.926175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f6be1b3-6e4e-4880-9b3b-02b446d1e135 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:11.926797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f6be1b3-6e4e-4880-9b3b-02b446d1e135 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:11.927767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f6be1b3-6e4e-4880-9b3b-02b446d1e135 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:11.928539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f6be1b3-6e4e-4880-9b3b-02b446d1e135 None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:11.929098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:11.929944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:11.943675 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.compute.rpcapi [None req-9f6be1b3-6e4e-4880-9b3b-02b446d1e135 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 13:19:11.945016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f6be1b3-6e4e-4880-9b3b-02b446d1e135 None None] Releasing lock "compute-rpcapi-router" {{(pid=117282) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 13:19:11.948221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:11.949805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:11.950593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:11.952172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:11.964399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f6be1b3-6e4e-4880-9b3b-02b446d1e135 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.811437 Mar 08 13:19:11.966122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 10/27] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:12.372036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:12.373180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:12.397154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:12.397957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:12.399129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:12.400027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:12.549579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:12.560478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0d68784d-8f5e-4d15-94b5-51580bc66035 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.636671 Mar 08 13:19:12.561732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 18/28] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:11 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:12.765591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:12.781198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e999f88e-3055-4583-89ec-d0927e425f22 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1218 microversion: 2.1 time: 0.423555 Mar 08 13:19:12.794079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 11/29] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:12 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:13.587965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:13.589269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:13.598977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:13.599690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:13.600761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:13.604216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:13.817089 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:13.817782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:13.850495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:13.857005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:13.857927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:13.860305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:14.128637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:14.144092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c6978cde-d1ac-4f10-b700-4217027e87c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1282 microversion: 2.1 time: 0.343331 Mar 08 13:19:14.147240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 12/30] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:13 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1282 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:14.229617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:14.249120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5820d35a-b58e-4b56-8687-285b38af52f8 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.673388 Mar 08 13:19:14.261571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 19/31] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:13 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:15.172261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:15.173065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:15.182585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:15.184080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:15.188862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:15.189743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:15.268265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:15.269130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:15.282203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:15.286681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:15.292489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:15.294414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:15.755939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:15.763529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e7eedcce-0dd3-47f9-ad9f-c1aa3b23473b tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.498161 Mar 08 13:19:15.765078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 20/32] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:15 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:15.843016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:15.851176 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-af832803-deb9-4417-83dc-471f4b66ccee tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1280 microversion: 2.1 time: 0.683334 Mar 08 13:19:15.851837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 13/33] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:15 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1280 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:15.991519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2084474266", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03edc10a-5365-4b5f-86af-57e7b3dff290"}], "security_groups": [{"name": "tempest-securitygroup--1140948361"}], "key_name": "tempest-keypair-585172195", "user_data": "}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:16.186669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] validate_networks() for [('03edc10a-5365-4b5f-86af-57e7b3dff290', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:19:16.785764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:16.786360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:16.800907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:16.802282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:16.803223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:16.803815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:17.203309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:19:17.203796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:19:17.204186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:19:17.204594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:19:17.205028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:19:17.218057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:17.218507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:17.219306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:17.219736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:17.281873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:17.298234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:17.370950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:19:17.373815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:19:17.518792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-815da113-e504-4898-b32d-4f17845588b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.532762 Mar 08 13:19:17.526953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 21/34] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:19:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:19:17.532521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:17.533443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:17.578072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:17.578556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:17.587705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:17.588256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:17.594737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:17.631525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d921504d-ad08-4098-b797-80cc38deaffc tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.850161 Mar 08 13:19:17.634744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 14/35] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:16 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:17.654051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cedf5801-45c7-4725-bb7b-5a47672688e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:17.655899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cedf5801-45c7-4725-bb7b-5a47672688e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:17.974234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cedf5801-45c7-4725-bb7b-5a47672688e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:17.974234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cedf5801-45c7-4725-bb7b-5a47672688e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1241 microversion: 2.1 time: 0.301141 Mar 08 13:19:17.974234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 15/36] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1241 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:18.144255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:18.163758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-26e44a05-820e-46b5-8e31-4d6bb4b4fa5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.635360 Mar 08 13:19:18.167929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 22/37] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:17 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:18.624775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-570941149", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d234632-92a1-48cd-bf8f-0912eabcf221"}], "security_groups": [{"name": "tempest-securitygroup--84957552"}], "key_name": "tempest-keypair-1216902503", "user_data": "}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:18.649380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:18.655066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:18.662055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:18.666481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:18.667483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:18.668050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:18.802708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.network.neutron [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] validate_networks() for [('7d234632-92a1-48cd-bf8f-0912eabcf221', None, None, None, None, None)] {{(pid=117282) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:19:18.865537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:18.874412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f506406-43f5-4cfe-b552-b5f5d03e1a5c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.229009 Mar 08 13:19:18.875374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 23/38] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:18 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:18.956813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c3484da7-013c-4db4-a2ea-49c3586e8031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:18.957606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c3484da7-013c-4db4-a2ea-49c3586e8031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:19.044465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c3484da7-013c-4db4-a2ea-49c3586e8031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:19.051971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c3484da7-013c-4db4-a2ea-49c3586e8031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1241 microversion: 2.1 time: 0.098890 Mar 08 13:19:19.051971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 24/39] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:19.185569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:19.187284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:19.199679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.200130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.201145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.201585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.371292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:19.381211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a71bb36a-a960-4d74-9009-64fbcb694528 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.200573 Mar 08 13:19:19.381798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 25/40] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:19 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:19.657880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-0dffb879-65f2-4895-ab82-27e29b7fe4c6 req-940d6897-ea59-42fe-8bfc-e6b0749d0088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd6bc389-6db6-4800-b030-7ee0a855e6de", "tag": "98899da2-e854-4088-a9e8-69cc2165bfd8"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:19.694148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-0dffb879-65f2-4895-ab82-27e29b7fe4c6 req-940d6897-ea59-42fe-8bfc-e6b0749d0088 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.696421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-0dffb879-65f2-4895-ab82-27e29b7fe4c6 req-940d6897-ea59-42fe-8bfc-e6b0749d0088 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.751379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-0dffb879-65f2-4895-ab82-27e29b7fe4c6 req-940d6897-ea59-42fe-8bfc-e6b0749d0088 service nova] Creating event network-changed:98899da2-e854-4088-a9e8-69cc2165bfd8 for instance dd6bc389-6db6-4800-b030-7ee0a855e6de on hv-cinder-83009 Mar 08 13:19:19.751929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-0dffb879-65f2-4895-ab82-27e29b7fe4c6 req-940d6897-ea59-42fe-8bfc-e6b0749d0088 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117280) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 13:19:19.759749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66eb7d28-2697-4469-b1b3-3004f5e019ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.760207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66eb7d28-2697-4469-b1b3-3004f5e019ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.761472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66eb7d28-2697-4469-b1b3-3004f5e019ed None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.762298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66eb7d28-2697-4469-b1b3-3004f5e019ed None None] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.786282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.compute.rpcapi [None req-66eb7d28-2697-4469-b1b3-3004f5e019ed None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 13:19:19.793476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66eb7d28-2697-4469-b1b3-3004f5e019ed None None] Releasing lock "compute-rpcapi-router" {{(pid=117280) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 13:19:19.824856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Flavor limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:19:19.826855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Image limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:19:19.827398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Flavor pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:19:19.828011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Image pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:19:19.828618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:19:19.829490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-66eb7d28-2697-4469-b1b3-3004f5e019ed None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369832 Mar 08 13:19:19.830301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 26/41] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:19:19.841622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.842473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.843480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.844097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.878721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for project 500118b8b6da4bba959c36961a149a19. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:19:19.879826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for user ced48ea897124de6b874e797b6d74f3d and project 500118b8b6da4bba959c36961a149a19. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:19:19.893878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:19.894905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:19.895998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Going to run 1 instances... {{(pid=117282) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:19:19.900527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:19:19.919432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.919432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:19.919432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:19.919657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:20.112542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fc5f3b8d-976c-41d0-b142-04ddbde5273c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.493971 Mar 08 13:19:20.120117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 16/42] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Mar 8 13:19:18 2022] POST /compute/v2.1/servers => generated 400 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 13:19:20.125392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7f185cb5-15f0-4155-875c-9a6a896799e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:20.126263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7f185cb5-15f0-4155-875c-9a6a896799e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:20.191630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:20.204406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b5297ae3-6934-45dd-8077-d568a4adcf14 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.316200 Mar 08 13:19:20.213606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 27/43] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:19 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:20.220065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-05c7a576-44f2-4008-a81e-2427c10e2bc5 req-469a4327-7527-494a-8bc7-a98754ecf3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45689a4d-e873-4671-a91a-ef1754ba3ff4", "tag": "d984c1fd-5ea3-4f59-b6fb-7b0e99488b7a"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:20.247809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-05c7a576-44f2-4008-a81e-2427c10e2bc5 req-469a4327-7527-494a-8bc7-a98754ecf3f6 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:20.247937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7f185cb5-15f0-4155-875c-9a6a896799e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:20.248041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-05c7a576-44f2-4008-a81e-2427c10e2bc5 req-469a4327-7527-494a-8bc7-a98754ecf3f6 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:20.259839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7f185cb5-15f0-4155-875c-9a6a896799e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1241 microversion: 2.1 time: 0.135202 Mar 08 13:19:20.262036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 17/44] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:20.271759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-05c7a576-44f2-4008-a81e-2427c10e2bc5 req-469a4327-7527-494a-8bc7-a98754ecf3f6 service nova] Creating event network-changed:d984c1fd-5ea3-4f59-b6fb-7b0e99488b7a for instance 45689a4d-e873-4671-a91a-ef1754ba3ff4 on hv-cinder-83009 Mar 08 13:19:20.275240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-66fbe151-ec0e-4b4e-a3e6-528db0ac3cd8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:20.275970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-66fbe151-ec0e-4b4e-a3e6-528db0ac3cd8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:20.278336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-05c7a576-44f2-4008-a81e-2427c10e2bc5 req-469a4327-7527-494a-8bc7-a98754ecf3f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071515 Mar 08 13:19:20.282342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 28/45] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:20.406956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:20.414512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:20.431918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:20.433956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:20.435009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:20.435721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:20.523781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-66fbe151-ec0e-4b4e-a3e6-528db0ac3cd8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:20.532851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-66fbe151-ec0e-4b4e-a3e6-528db0ac3cd8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:20.534643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-66fbe151-ec0e-4b4e-a3e6-528db0ac3cd8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:20.535955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-66fbe151-ec0e-4b4e-a3e6-528db0ac3cd8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1281 microversion: 2.20 time: 0.272881 Mar 08 13:19:20.537584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 18/46] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:20.758447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:20.766615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-860cb5e8-27a0-4a07-88c9-51952b2a716b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.372115 Mar 08 13:19:20.767184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 29/47] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:20 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:21.221416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:21.222035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:21.228398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.228876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.229656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.230101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.279108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:21.280083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:21.287712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.288690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.289812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.290557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.379229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:21.379387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:21.388020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8be188fa-40e5-4eb4-bb12-e53ce3334197 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1237 microversion: 2.1 time: 0.114701 Mar 08 13:19:21.388976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 30/48] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:21.404836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cf4ee0a3-1d17-42d8-8041-aa91ddc0e24c tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.187433 Mar 08 13:19:21.405426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 19/49] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:21 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:21.554835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:21.555470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:21.563805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.569436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.569436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.569436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.784569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:21.784739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:21.785281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:21.791838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.792301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.793262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:21.793701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:21.796458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:21.798061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:21.799169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-859daf2d-12cd-4dff-8560-51331b0bc316 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1285 microversion: 2.20 time: 0.248843 Mar 08 13:19:21.799979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 31/50] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:21.935034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:21.942422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d669a2ed-ae2a-439e-be71-438cb734968b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.161808 Mar 08 13:19:21.942983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 20/51] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:21 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:22.409396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:22.416006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:22.423040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:22.423863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:22.426217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.427937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:22.427937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.427937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:22.431197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.431949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:22.433142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.433655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:22.494454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:22.502188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d0409401-8d24-46e4-a3f4-c941e1770c9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1237 microversion: 2.1 time: 0.100509 Mar 08 13:19:22.502758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 32/52] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:22.581843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:22.589512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c9bc2809-ae20-4a19-b144-9451c8f28f10 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.171582 Mar 08 13:19:22.590082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 21/53] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:22 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:22.817511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:22.818170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:22.825422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.825961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:22.827149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.827644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:22.887248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:22.895350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:22.902770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:22.902770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6f5650e1-a284-45cb-8b8e-e0521ba746f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1285 microversion: 2.20 time: 0.084819 Mar 08 13:19:22.902770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 33/54] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:22.959049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:22.959662 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:22.966285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.966740 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:22.967505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:22.967947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:23.124509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:23.134847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c7102770-c050-45f9-abbc-7c53825437bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.179479 Mar 08 13:19:23.136888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 22/55] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:22 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:23.528853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:23.528853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:23.533358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:23.534017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:23.535017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:23.535617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:23.599576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:23.607459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3975e45e-3416-4bb7-8aa1-907d7a2bd0f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1293 microversion: 2.1 time: 0.092030 Mar 08 13:19:23.608076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 34/56] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:23.615073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:23.616500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:23.621764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:23.622155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:23.622916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:23.623350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:23.768843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:23.778104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8986ce76-16a9-4aeb-beae-a6ce1cf460a2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.164810 Mar 08 13:19:23.778104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 23/57] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:23 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:23.917321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:23.918490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:23.924884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:23.925378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:23.926135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:23.926568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:23.998375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:24.006777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:24.008800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:24.009975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4bb36278-25c5-45e1-ba4c-1838d0d5e40a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1277 microversion: 2.20 time: 0.096986 Mar 08 13:19:24.020767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 35/58] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:24.153902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:24.154502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:24.160969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:24.166495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:24.166495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:24.166495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:24.305935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:24.313394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2cb5250a-3e69-40f1-8922-d2a72aea045e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.163826 Mar 08 13:19:24.313959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 24/59] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:24 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:24.627829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:24.628923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:24.638058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:24.638555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:24.639511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:24.640294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:24.711974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:24.719332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-076e2b40-0885-4e37-b5f6-1d6c5b86b2b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1293 microversion: 2.1 time: 0.098551 Mar 08 13:19:24.719895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 36/60] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:24.794028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:24.794663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:24.800778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:24.801318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:24.802116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:24.802622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:24.940954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:24.948804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a2c4227c-de9e-4a8b-b1df-305b5d61bb13 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.158786 Mar 08 13:19:24.949372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 25/61] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:24 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:25.029360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:25.029966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:25.035880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.036328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:25.037147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.037578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:25.095662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:25.103983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:25.105817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:25.106935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8d23e0f8-f749-4c94-98cb-016c9f9640de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1277 microversion: 2.20 time: 0.081464 Mar 08 13:19:25.107499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 37/62] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:25.330855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:25.331501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:25.338061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.338510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:25.339263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.339733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:25.480780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:25.488333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-50042b03-681f-4f40-83d9-7ab33acc2727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.161435 Mar 08 13:19:25.488929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 26/63] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:25 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:25.738181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:25.739594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:25.752828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.753293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:25.754078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.754518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:25.813530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:25.821236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5e3b35e2-3579-48f8-a57a-b1363489239a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1293 microversion: 2.1 time: 0.089279 Mar 08 13:19:25.821803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 38/64] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:25.965922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:25.966537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:25.972405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.972892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:25.973658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:25.974112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:26.126633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:26.127268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:26.134574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:26.134966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:26.135750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:26.139841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:26.180683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:26.197513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2a25383d-a93e-4970-bdc2-c44ba4781168 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.232850 Mar 08 13:19:26.197513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 27/65] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:25 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:26.197835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:26.212732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:26.214533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:26.216017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5a934d77-fed5-474a-b88d-b112e872153c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1277 microversion: 2.20 time: 0.094056 Mar 08 13:19:26.216834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 39/66] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:26.505781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:26.506603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:26.517578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:26.518252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:26.519253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:26.519539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:26.653617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:26.661240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3717c86a-6973-4893-a1be-d84737005cca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.159132 Mar 08 13:19:26.661803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 28/67] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:26 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:26.838734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:26.839339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:26.845509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:26.845953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:26.846713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:26.847142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:26.906298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:26.913459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9c1ec6de-10ed-4e2b-85b7-4a472eaa6636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1301 microversion: 2.1 time: 0.079396 Mar 08 13:19:26.914022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 40/68] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1301 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:27.213080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:27.213682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:27.219509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.219957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.220736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.221172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.235376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:27.235973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:27.241846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.242289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.243048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.243479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.302256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:27.310233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:27.311658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:27.312778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d6656314-7092-41c2-bb5c-a0b010a225d2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1333 microversion: 2.20 time: 0.081194 Mar 08 13:19:27.313370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 41/69] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1333 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:27.359518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:27.367029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c189cc87-6b77-432f-9464-fa2ba40940d6 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.158764 Mar 08 13:19:27.367596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 29/70] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:27 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:27.678738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:27.679957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:27.685846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.686310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.687066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.687500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.821657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:27.828833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a46f7c85-d4f6-4373-beeb-5fc396f213be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.153862 Mar 08 13:19:27.829422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 42/71] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:27 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:27.931207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:27.931743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:27.937634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.938080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.938826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:27.939253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:27.997667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:28.004834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6f34e4b4-9da3-4226-93a8-6bd89a1f4c0b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1301 microversion: 2.1 time: 0.078180 Mar 08 13:19:28.005389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 30/72] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1301 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:28.331283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:28.331819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:28.338181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:28.338634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:28.339397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:28.339837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:28.383399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:28.384067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:28.392270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:28.393026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:28.394185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:28.394848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:28.400611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:28.409057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:28.411001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:28.412036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8de8c82e-552a-48df-a2ea-628a47ce73a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1333 microversion: 2.20 time: 0.084737 Mar 08 13:19:28.412899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 43/73] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:28.535200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:28.543220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-58f81a7b-1982-42e3-9876-4adfc842786e tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.163863 Mar 08 13:19:28.543790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 31/74] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:28 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:28.845445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:28.846052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:28.852029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:28.852486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:28.853290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:28.853726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:28.988270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:28.995582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e8d8b427-315e-4860-bd70-efcfc94d3897 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.153908 Mar 08 13:19:28.996073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 44/75] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:28 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:29.021780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:29.023094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:29.029001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:29.029451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:29.030214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:29.030650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:29.091379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:29.111379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f622b42d-1d1a-4c0e-a533-5edf5a5621c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1301 microversion: 2.1 time: 0.093098 Mar 08 13:19:29.112322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 32/76] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:29.438640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:29.439260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:29.447241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:29.447738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:29.448520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:29.448985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:29.533937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:29.543956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:29.545483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:29.547357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-426a3f5d-c145-469c-b0df-2a5083fb0ba9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1341 microversion: 2.20 time: 0.119484 Mar 08 13:19:29.547917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 45/77] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1341 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:29.563380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:29.564027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:29.570647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:29.571111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:29.571899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:29.572330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:29.849384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:29.858169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4936eb28-543a-4104-ba6f-56b3a6c8c79f tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.299888 Mar 08 13:19:29.858735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 33/78] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:29 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:30.014960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:30.015859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:30.025616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.026356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:30.027419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.028099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:30.130164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:30.140057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:30.140057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.141065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:30.141944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.142654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:30.342397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:30.355821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1cdd35a8-3527-4ee3-a7ef-124143e692da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.344420 Mar 08 13:19:30.356557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 46/79] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:30 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:30.410195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:30.421428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6ebc710a-2b4f-4483-a18d-81d66aca66dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.294532 Mar 08 13:19:30.425897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 34/80] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:30.582103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:30.583076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:30.603229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.603690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:30.604483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.605205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:30.844989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:30.858458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:30.861159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:30.863034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-78b031e3-5d3a-4930-9240-9163f4d85c77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.293838 Mar 08 13:19:30.877442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 47/81] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:30.878536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:30.882245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:30.900047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.900551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:30.901313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:30.901748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:31.357693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:31.372408 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6b12379b-8771-4abd-a578-d26924d615d0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.500053 Mar 08 13:19:31.373751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 35/82] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:30 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:31.381863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:31.382844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:31.389286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:31.392824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:31.392824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:31.392824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:31.443485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:31.444128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:31.451032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:31.451475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:31.452240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:31.452685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:31.765632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:31.779006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cf0535ed-ed1a-4848-8827-8971481ee61d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.398342 Mar 08 13:19:31.781596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 48/83] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:31 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:31.798240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-e1387379-35ce-4bab-af09-cc3fc71fe3f2 req-5cd65700-c737-4aa4-a0fa-c99da540dd90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701ec119-507b-4b00-b365-bb76f36feab1", "tag": "96401a0d-79b1-4f30-8dd7-46c5c4b2731f"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:31.821643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-e1387379-35ce-4bab-af09-cc3fc71fe3f2 req-5cd65700-c737-4aa4-a0fa-c99da540dd90 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:31.826699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-e1387379-35ce-4bab-af09-cc3fc71fe3f2 req-5cd65700-c737-4aa4-a0fa-c99da540dd90 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:31.851993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-e1387379-35ce-4bab-af09-cc3fc71fe3f2 req-5cd65700-c737-4aa4-a0fa-c99da540dd90 service nova] Creating event network-changed:96401a0d-79b1-4f30-8dd7-46c5c4b2731f for instance 701ec119-507b-4b00-b365-bb76f36feab1 on hv-cinder-83009 Mar 08 13:19:31.858888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-e1387379-35ce-4bab-af09-cc3fc71fe3f2 req-5cd65700-c737-4aa4-a0fa-c99da540dd90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074943 Mar 08 13:19:31.860622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 49/84] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:31.886601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:31.887623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:31.910315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:31.911002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:31.915909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:31.916481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:32.004117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:32.017467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9bdabc50-3af5-4939-9f23-be1b7666e6bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.576520 Mar 08 13:19:32.017467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 36/85] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:32.165070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:32.174163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:32.176050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:32.177512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e9fd94e8-311b-45a1-855c-49c696b8a0eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.297608 Mar 08 13:19:32.179125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 50/86] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:32.242789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-97f8316a-5d55-4fc4-b2ad-1d59a578a015 req-0a76d989-94cc-4afb-b6b6-5bcd06b184c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9aabe1-38e8-4c68-aafc-9a389ce1c127", "tag": "5aa555ed-04a0-4927-ab06-464b9c259a70"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:32.260713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-97f8316a-5d55-4fc4-b2ad-1d59a578a015 req-0a76d989-94cc-4afb-b6b6-5bcd06b184c5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:32.261296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-97f8316a-5d55-4fc4-b2ad-1d59a578a015 req-0a76d989-94cc-4afb-b6b6-5bcd06b184c5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:32.318242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-97f8316a-5d55-4fc4-b2ad-1d59a578a015 req-0a76d989-94cc-4afb-b6b6-5bcd06b184c5 service nova] Creating event network-changed:5aa555ed-04a0-4927-ab06-464b9c259a70 for instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 on hv-cinder-83009 Mar 08 13:19:32.345586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-97f8316a-5d55-4fc4-b2ad-1d59a578a015 req-0a76d989-94cc-4afb-b6b6-5bcd06b184c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105907 Mar 08 13:19:32.347580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 37/87] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:19:32.394347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:32.395230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:32.410576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:32.411047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:32.412460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:32.413015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:32.499952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-fc71cac4-0870-4f1c-b643-5c2ce822bd2b req-83bdcd44-c4c7-4cff-be89-345104d436af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13664093-145a-4f1d-9ed3-cc61a73ed00b", "name": "network-vif-plugged", "status": "completed", "tag": "103e07a3-2988-48cc-8dc9-f04152af20ec"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:32.532876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-fc71cac4-0870-4f1c-b643-5c2ce822bd2b req-83bdcd44-c4c7-4cff-be89-345104d436af service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:32.533428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-fc71cac4-0870-4f1c-b643-5c2ce822bd2b req-83bdcd44-c4c7-4cff-be89-345104d436af service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:32.564252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-fc71cac4-0870-4f1c-b643-5c2ce822bd2b req-83bdcd44-c4c7-4cff-be89-345104d436af service nova] Creating event network-vif-plugged:103e07a3-2988-48cc-8dc9-f04152af20ec for instance 13664093-145a-4f1d-9ed3-cc61a73ed00b on hv-cinder-83009 Mar 08 13:19:32.574496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-fc71cac4-0870-4f1c-b643-5c2ce822bd2b req-83bdcd44-c4c7-4cff-be89-345104d436af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213193 Mar 08 13:19:32.575784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 51/88] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:32.798907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:32.799603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:32.806565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:32.807522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:32.807991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:32.808432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:32.925909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:32.935438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a087e970-e1d8-4dd3-87ca-857f623fada1 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.548371 Mar 08 13:19:32.936017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 38/89] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:32 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:32.989498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:32.997478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-44b811cf-1752-4ddb-914f-698547478098 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.202760 Mar 08 13:19:32.998321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 52/90] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:32 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:33.040029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:33.041220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:33.047088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:33.047543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:33.048329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:33.048810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:33.181001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:33.188254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e6898a77-77a5-430f-9a0a-25472fc7ffbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.152910 Mar 08 13:19:33.188856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 39/91] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:33.197286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:33.197889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:33.203710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:33.204155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:33.204953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:33.205384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:33.331821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:33.340196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:33.341739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:33.342850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9233c446-7b29-4059-9c72-9622c5815320 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.150329 Mar 08 13:19:33.343428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 53/92] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:33.952727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:33.953379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:33.959234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:33.959975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:33.960765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:33.961200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.014585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:34.015181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:34.021893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:34.022585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.023357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:34.024876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.108050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:34.115776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-99a2f539-b107-4396-831b-4a24631259b2 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.167015 Mar 08 13:19:34.124707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 40/93] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:33 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:34.206313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:34.206919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:34.213610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:34.214066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.214834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:34.215266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.332216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:34.341059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-32fd4ecd-015d-4ec7-ac75-1d6564df5803 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.330219 Mar 08 13:19:34.341837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 54/94] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:34 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:34.353448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:34.360976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:34.361603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:34.361710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-57a55617-5326-43f8-8e9c-c500aa3998f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.159241 Mar 08 13:19:34.362202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 41/95] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:34.367421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:34.367865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.368617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:34.369079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.502745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:34.510509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:34.512038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:34.513191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ca945b7a-829a-45af-9322-96ed69c43fa1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.155974 Mar 08 13:19:34.528501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 55/96] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:34 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:34.591063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-f735e5de-dc9d-434a-9168-f2ea58397ce4 req-3e69939b-8652-458e-85ad-e561a8619fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd6bc389-6db6-4800-b030-7ee0a855e6de", "name": "network-vif-plugged", "status": "completed", "tag": "98899da2-e854-4088-a9e8-69cc2165bfd8"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:34.598883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-f735e5de-dc9d-434a-9168-f2ea58397ce4 req-3e69939b-8652-458e-85ad-e561a8619fdf service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:34.599347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-f735e5de-dc9d-434a-9168-f2ea58397ce4 req-3e69939b-8652-458e-85ad-e561a8619fdf service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:34.610563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-f735e5de-dc9d-434a-9168-f2ea58397ce4 req-3e69939b-8652-458e-85ad-e561a8619fdf service nova] Creating event network-vif-plugged:98899da2-e854-4088-a9e8-69cc2165bfd8 for instance dd6bc389-6db6-4800-b030-7ee0a855e6de on hv-cinder-83009 Mar 08 13:19:34.615565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-f735e5de-dc9d-434a-9168-f2ea58397ce4 req-3e69939b-8652-458e-85ad-e561a8619fdf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028129 Mar 08 13:19:34.616709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 42/97] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:19:35.133718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:35.134325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:35.140065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.140511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.141299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.141736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.272364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:35.279821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3d64e009-76fe-421c-9380-03fa1f4e13c7 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.150481 Mar 08 13:19:35.280369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 56/98] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:35 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:35.358661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:35.359299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:35.365323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.365769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.367053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.367479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.378612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:35.379229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:35.385193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.385643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.386407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.386842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.532500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:35.550271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4dd9bc07-33ca-479b-86b2-f072cd54de4a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.195488 Mar 08 13:19:35.556065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 43/99] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:35 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:35.570907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:35.572416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:35.585989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.586616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.587499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:35.588098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:35.715721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:35.726604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d0f01054-52d1-491a-887b-7a9ef67c3f99 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.351885 Mar 08 13:19:35.730556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 57/100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:35.816785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:35.829113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:35.830634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:35.831741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6d729434-4963-40be-980e-3d5759062910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.273660 Mar 08 13:19:35.833227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 44/101] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:36.298949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:36.300701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:36.314302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.315869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.322434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.322434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.509999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:36.517442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0cd434bb-2119-469b-92a7-a6e73b548496 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.224455 Mar 08 13:19:36.522965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 58/102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:36 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:36.578401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:36.578401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:36.586614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.587062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.587838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.588274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.751236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:36.751236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:36.757437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.758021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.758878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.759388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.804336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:36.811907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-63e4404e-5259-4197-813a-a862ead62e10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.244185 Mar 08 13:19:36.812685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 45/103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:36 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:36.852085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:36.853033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:36.860585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.861228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.862439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:36.863078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:36.934674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:36.942975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-29ea0811-7bdb-432e-ae7c-d629920c8929 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.201575 Mar 08 13:19:36.942975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 59/104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:37.027088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:37.034958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:37.036472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:37.037644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-161ec3a9-2cb1-4a0a-8cec-b75840b47f4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.190385 Mar 08 13:19:37.042695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 46/105] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:37.533922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:37.538477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:37.540939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:37.541379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:37.542132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:37.542560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:37.673731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:37.682298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a3f02a29-ed84-4720-931c-f74a3aae9e0a tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1315 microversion: 2.1 time: 0.152173 Mar 08 13:19:37.692264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 60/106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:37 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:37.829748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:37.830955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:37.837552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:37.838085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:37.838932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:37.839437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:37.941988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-36fe62b4-44ff-4b64-99b3-252c80a9a2cb req-75bedabd-d1ea-41c3-932e-e3dad5e807d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45689a4d-e873-4671-a91a-ef1754ba3ff4", "name": "network-vif-plugged", "status": "completed", "tag": "d984c1fd-5ea3-4f59-b6fb-7b0e99488b7a"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:37.952423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-36fe62b4-44ff-4b64-99b3-252c80a9a2cb req-75bedabd-d1ea-41c3-932e-e3dad5e807d5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:37.952905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-36fe62b4-44ff-4b64-99b3-252c80a9a2cb req-75bedabd-d1ea-41c3-932e-e3dad5e807d5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:37.965547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-36fe62b4-44ff-4b64-99b3-252c80a9a2cb req-75bedabd-d1ea-41c3-932e-e3dad5e807d5 service nova] Creating event network-vif-plugged:d984c1fd-5ea3-4f59-b6fb-7b0e99488b7a for instance 45689a4d-e873-4671-a91a-ef1754ba3ff4 on hv-cinder-83009 Mar 08 13:19:37.970744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-36fe62b4-44ff-4b64-99b3-252c80a9a2cb req-75bedabd-d1ea-41c3-932e-e3dad5e807d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033094 Mar 08 13:19:37.971591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 61/107] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:37.980498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:37.981470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:37.986407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:37.991659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:37.992641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:37.993827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:37.994419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:37.994950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a3cd1c61-e2d2-44ef-9f34-5755479ecd36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.169087 Mar 08 13:19:37.995527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 47/108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:37 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:38.055718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:38.056492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:38.063622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:38.064273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:38.065081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:38.065521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:38.134199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:38.142074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b608c1d1-71a2-460e-b520-463322c3a099 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.167217 Mar 08 13:19:38.142652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 62/109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:38.241874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:38.250315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:38.251829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:38.252948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-992bb92d-b64c-411d-9f5f-68b5179ac218 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.201191 Mar 08 13:19:38.253521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 48/110] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:38 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:38.703936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:38.705247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:38.711959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:38.715107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:38.715107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:38.715107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:38.849942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:38.858619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6f66084f-aeab-4e47-ac2f-44ee72e51b23 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1501 microversion: 2.1 time: 0.159253 Mar 08 13:19:38.859195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 63/111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:38 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:39.011154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:39.011750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:39.017645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:39.018086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:39.018842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:39.019303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:39.158810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:39.162531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:39.162531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:39.166702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:39.167420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:39.168185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6db6cc27-de9e-4b6c-be90-81667c0766ef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.160182 Mar 08 13:19:39.168792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:39.169426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:39.173884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 49/112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:39 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:39.271406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:39.272554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:39.280293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:39.281752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:39.285617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:39.286557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:39.338431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:39.348307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b4786766-a29b-4673-8161-10c4f3355970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.192587 Mar 08 13:19:39.352760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 64/113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:39.466597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:39.474313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:39.477131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:39.478237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a7f4ed81-72cb-4da8-b2b8-c1bb15410925 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.210603 Mar 08 13:19:39.478790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 50/114] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:40.185559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:40.186168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:40.196028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:40.196574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:40.202638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:40.203083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:40.343448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:40.351636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e94cc3ea-c0e5-43a0-b488-f68cdb9c22cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.170324 Mar 08 13:19:40.352204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 65/115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:40 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:40.366393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:40.366982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:40.372939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:40.373453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:40.374305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:40.374801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:40.496082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:40.496797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:40.502938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:40.503392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:40.504163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:40.504782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:40.510920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:40.518056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3917cf37-af99-41c3-a9be-327af9f465dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.155694 Mar 08 13:19:40.519187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 51/116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:40.672160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:40.681715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:40.683406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:40.684694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dfb0a065-263b-4b5e-be17-f6dcb85439d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.192975 Mar 08 13:19:40.685699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 66/117] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:41.368707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:41.369317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:41.375169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:41.375622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:41.376390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:41.376854 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:41.519485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:41.527043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d8060f40-6140-47cc-8e19-4095f00e3638 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1322 microversion: 2.1 time: 0.162492 Mar 08 13:19:41.535144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:41.536388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 52/118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:41 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:41.537065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:41.543671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:41.544372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:41.545064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:41.545494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:41.677177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:41.685974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ebe1d76c-759f-4c08-b8b9-3b19ce5d9d60 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.154598 Mar 08 13:19:41.686534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 67/119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:41.703111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:41.703707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:41.709952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:41.710398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:41.711210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:41.711582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:41.850579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:41.858502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:41.860004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:41.861339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e9b97fcb-2c30-4c39-9e42-63557767dd47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.162076 Mar 08 13:19:41.861889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 53/120] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:42.543923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:42.544932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:42.550994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.551548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:42.552373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.553477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:42.691725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:42.700156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cb020206-6e2c-4e0d-be00-4b1388c63dd1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1516 microversion: 2.1 time: 0.160081 Mar 08 13:19:42.700743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 68/121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:42 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:42.702727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:42.703711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:42.709317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.710458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:42.711235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.711676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:42.717328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:42.721846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:42.724069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.724520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:42.725330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.725934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:42.793439 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lazy-loading 'flavor' on Instance uuid 45689a4d-e873-4671-a91a-ef1754ba3ff4 {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:19:42.884344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:42.894667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a28202a3-078f-452a-a42c-956b5c23a75f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.195591 Mar 08 13:19:42.895708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 54/122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:42.910669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:42.911587 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:42.919913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.920610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:42.925270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:42.925270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:43.070425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:43.079135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:43.080893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:43.082086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-551da01c-029a-4504-a075-ea1e372c1d21 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.175860 Mar 08 13:19:43.082723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 55/123] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:43.358921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b146381a-3549-4d98-8b23-eeb275e71a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4/action" status: 200 len: 32 microversion: 2.1 time: 0.645328 Mar 08 13:19:43.360146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 69/124] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:19:42 2022] POST /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4/action => generated 32 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 08 13:19:43.369502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:43.370152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:43.382792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:43.383426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:43.384260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:43.384649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:43.559829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:43.567244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d802536d-784f-44ab-aa2f-7a41404d3b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.202434 Mar 08 13:19:43.567870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 56/125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:43 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:43.912337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:43.913600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:43.920471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:43.921264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:43.922240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:43.922817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.066086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:44.074083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-35d8ce91-b4a5-44d6-97c1-f62d2430748c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.166509 Mar 08 13:19:44.075959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 70/126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:44.100931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:44.101532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:44.107688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:44.108134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.108918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:44.109346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.266414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:44.274561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:44.276102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:44.277912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f8f45105-e7fb-4914-be77-bbca2aaeee88 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.180330 Mar 08 13:19:44.278477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 57/127] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:19:44.429664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-df4d932d-e70a-454e-b9bf-a1edae04f373 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d10a2c37-17a1-43e2-9f19-90d43d303132"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:44.431347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-df4d932d-e70a-454e-b9bf-a1edae04f373 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:44.439707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df4d932d-e70a-454e-b9bf-a1edae04f373 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:44.440155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df4d932d-e70a-454e-b9bf-a1edae04f373 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.440967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df4d932d-e70a-454e-b9bf-a1edae04f373 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:44.441576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df4d932d-e70a-454e-b9bf-a1edae04f373 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.588055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:44.588958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:44.596534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:44.597133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.600477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:44.601398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.751929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:44.767646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f3e478d-627a-4ae1-b722-68022320e3de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.186237 Mar 08 13:19:44.781655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 58/128] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:44 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:44.788914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-cffbd6b0-cc88-4fe1-a1b9-e97bbee0f11a req-c6903549-9e0d-4550-89a5-c58bd671e40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9aabe1-38e8-4c68-aafc-9a389ce1c127", "name": "network-vif-plugged", "status": "completed", "tag": "5aa555ed-04a0-4927-ab06-464b9c259a70"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:44.815265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-cffbd6b0-cc88-4fe1-a1b9-e97bbee0f11a req-c6903549-9e0d-4550-89a5-c58bd671e40d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:44.823727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-cffbd6b0-cc88-4fe1-a1b9-e97bbee0f11a req-c6903549-9e0d-4550-89a5-c58bd671e40d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:44.831627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-cffbd6b0-cc88-4fe1-a1b9-e97bbee0f11a req-c6903549-9e0d-4550-89a5-c58bd671e40d service nova] Creating event network-vif-plugged:5aa555ed-04a0-4927-ab06-464b9c259a70 for instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 on hv-cinder-83009 Mar 08 13:19:44.857894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-cffbd6b0-cc88-4fe1-a1b9-e97bbee0f11a req-c6903549-9e0d-4550-89a5-c58bd671e40d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066008 Mar 08 13:19:44.857894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 59/129] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:45.092420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:45.093244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:45.099642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:45.100182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:45.101070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:45.101649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:45.235592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:45.244908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-95304084-3d94-4ac6-bae0-327a9344e03b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.157486 Mar 08 13:19:45.245526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 60/130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:45.295932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:45.296618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:45.302485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:45.302961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:45.306589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:45.306589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:45.457348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:45.467187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:45.468731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:45.470370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b890e1d-91b3-43ca-86b4-2d8e75acda41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.178408 Mar 08 13:19:45.471384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 61/131] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:45.798208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:45.799250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:45.807104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:45.807758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:45.808586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:45.809047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:45.951867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:45.959197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ef0b5e31-151e-4c92-a2dd-af9b96b0aee6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.174057 Mar 08 13:19:45.959882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 62/132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:45 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:46.262578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:46.263272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:46.269765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:46.270267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:46.271799 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:46.272250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:46.371812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-df4d932d-e70a-454e-b9bf-a1edae04f373 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "POST /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.948246 Mar 08 13:19:46.372428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 71/133] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:19:44 2022] POST /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b/os-volume_attachments => generated 194 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:46.493458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:46.493602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:46.500805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:46.501572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:46.502595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:46.508561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:46.510103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:46.528403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9a896ff3-c566-4024-987f-9e267aa58854 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.269779 Mar 08 13:19:46.529280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 63/134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:46.654495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:46.663196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:46.664829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:46.666040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5b600d61-861d-4f3b-bcf6-a9c293ca11d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1405 microversion: 2.20 time: 0.178280 Mar 08 13:19:46.666678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 72/135] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:46.874045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-fce08bb9-0c72-4a51-9ade-6147bb81fb09 req-c4e9ba58-3f24-480b-a2d1-6cc8eea80561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701ec119-507b-4b00-b365-bb76f36feab1", "name": "network-vif-plugged", "status": "completed", "tag": "96401a0d-79b1-4f30-8dd7-46c5c4b2731f"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:46.884202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-fce08bb9-0c72-4a51-9ade-6147bb81fb09 req-c4e9ba58-3f24-480b-a2d1-6cc8eea80561 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:46.884804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-fce08bb9-0c72-4a51-9ade-6147bb81fb09 req-c4e9ba58-3f24-480b-a2d1-6cc8eea80561 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:46.898454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-fce08bb9-0c72-4a51-9ade-6147bb81fb09 req-c4e9ba58-3f24-480b-a2d1-6cc8eea80561 service nova] Creating event network-vif-plugged:96401a0d-79b1-4f30-8dd7-46c5c4b2731f for instance 701ec119-507b-4b00-b365-bb76f36feab1 on hv-cinder-83009 Mar 08 13:19:46.903636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-fce08bb9-0c72-4a51-9ade-6147bb81fb09 req-c4e9ba58-3f24-480b-a2d1-6cc8eea80561 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Mar 08 13:19:46.904312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 64/136] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:19:46.976413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:46.977356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:46.984916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:46.985375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:46.986163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:46.986603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:47.128789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:47.136502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5381847e-f4ae-4497-bc6a-3f7c23d2e88b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.164892 Mar 08 13:19:47.137764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 73/137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:46 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:47.550079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:47.551383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:47.558242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:47.558695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:47.559456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:47.559886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:47.684547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:47.685198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:47.691752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:47.692202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:47.693024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:47.693654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:47.705934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:47.714830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2b97c234-a115-4d0f-894d-0a46e436aa69 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.168553 Mar 08 13:19:47.715418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 65/138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:47.862356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:47.873856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:47.876389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:47.878242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-866f7841-c344-472e-863a-3df5cc25e882 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1596 microversion: 2.20 time: 0.197832 Mar 08 13:19:47.879085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 74/139] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:19:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1596 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:19:47.907253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ad55a628-211e-496a-8fd6-74160b2f5121 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:47.907967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ad55a628-211e-496a-8fd6-74160b2f5121 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:47.914488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad55a628-211e-496a-8fd6-74160b2f5121 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:47.914933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad55a628-211e-496a-8fd6-74160b2f5121 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:47.915692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad55a628-211e-496a-8fd6-74160b2f5121 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:47.916123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad55a628-211e-496a-8fd6-74160b2f5121 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:48.044928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ad55a628-211e-496a-8fd6-74160b2f5121 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.141921 Mar 08 13:19:48.045505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 66/140] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Mar 8 13:19:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:19:48.154566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:48.155175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:48.161639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:48.162177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:48.163382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:48.163826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:48.441761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:48.451833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3caa718b-88f3-467a-9c75-96cfcf035d62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.301155 Mar 08 13:19:48.461600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 75/141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:48 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:48.733923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:48.734745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:48.741136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:48.741578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:48.742413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:48.743188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:48.904177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:48.912677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7172121a-cc67-4144-805e-cf2add11b1d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.182512 Mar 08 13:19:48.913903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 67/142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:49.469624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:49.470230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:49.477672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:49.478753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:49.480488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:49.481052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:49.756263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:49.763643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2d4d6e0f-11a6-4b9a-a6d9-a4e91a9de1a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.298069 Mar 08 13:19:49.764222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 76/143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:49 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:49.975725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-68d99f8e-ed71-44bd-8486-cf05dae698ce req-10a4f90f-77c5-4bd3-a285-7db71b175fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9aabe1-38e8-4c68-aafc-9a389ce1c127", "tag": "5aa555ed-04a0-4927-ab06-464b9c259a70"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:49.975725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-68d99f8e-ed71-44bd-8486-cf05dae698ce req-10a4f90f-77c5-4bd3-a285-7db71b175fc5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:49.975725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-68d99f8e-ed71-44bd-8486-cf05dae698ce req-10a4f90f-77c5-4bd3-a285-7db71b175fc5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:49.975725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-68d99f8e-ed71-44bd-8486-cf05dae698ce req-10a4f90f-77c5-4bd3-a285-7db71b175fc5 service nova] Creating event network-changed:5aa555ed-04a0-4927-ab06-464b9c259a70 for instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 on hv-cinder-83009 Mar 08 13:19:49.977004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-68d99f8e-ed71-44bd-8486-cf05dae698ce req-10a4f90f-77c5-4bd3-a285-7db71b175fc5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036607 Mar 08 13:19:49.977004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 68/144] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:49.977229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:49.977229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:49.977229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:49.977229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:49.977642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:49.977642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:50.219739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:50.230553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-81b78283-9bb3-4c81-8223-976076dde1ab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.304842 Mar 08 13:19:50.231073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 77/145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:50.782892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:50.783701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:50.791234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:50.791839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:50.793363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:50.793964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:51.137083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:51.149026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2a3a4710-cd50-41d5-96aa-b4571076a291 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.366850 Mar 08 13:19:51.149923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 69/146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:50 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:51.247725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:51.248418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:51.256434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:51.258331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:51.261227 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:51.261666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:51.428450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:51.435822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aed2aa87-11b5-4a04-b89b-79ae5f7f5eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1367 microversion: 2.1 time: 0.191962 Mar 08 13:19:51.436409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 78/147] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:52.167875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:52.168483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:52.174414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:52.180207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:52.180207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:52.180207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:52.467923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:52.467923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:52.470994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:52.484552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:52.484825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c23c3e7a-9b4a-458b-84b8-61206da45191 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.316647 Mar 08 13:19:52.485594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 70/148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:52 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:52.486301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:52.487616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:52.488138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:52.652275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:52.663928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-49852abd-cf97-434f-bd7b-6e4c4c4d03fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1557 microversion: 2.1 time: 0.210671 Mar 08 13:19:52.671897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 79/149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:52.685699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1491953d-271a-4dd4-9a9c-d0e28ee13ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:52.686217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1491953d-271a-4dd4-9a9c-d0e28ee13ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:52.694078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1491953d-271a-4dd4-9a9c-d0e28ee13ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:52.694534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1491953d-271a-4dd4-9a9c-d0e28ee13ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:52.695320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1491953d-271a-4dd4-9a9c-d0e28ee13ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:52.695752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1491953d-271a-4dd4-9a9c-d0e28ee13ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:52.796221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1491953d-271a-4dd4-9a9c-d0e28ee13ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123060 Mar 08 13:19:52.796879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 71/150] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Mar 8 13:19:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:53.502499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:53.503892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:53.511305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:53.512200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:53.513817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:53.514621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:53.663355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:53.671102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a864afdb-24aa-432b-b271-f12c929eb492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.172568 Mar 08 13:19:53.672295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 80/151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:53 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:54.481252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-865307c2-22cf-48e9-9059-5081c938c4dc req-6abb6f37-25b1-408a-8f77-cb131b2edc93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701ec119-507b-4b00-b365-bb76f36feab1", "tag": "96401a0d-79b1-4f30-8dd7-46c5c4b2731f"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:19:54.499504 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-865307c2-22cf-48e9-9059-5081c938c4dc req-6abb6f37-25b1-408a-8f77-cb131b2edc93 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:54.500146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-865307c2-22cf-48e9-9059-5081c938c4dc req-6abb6f37-25b1-408a-8f77-cb131b2edc93 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:54.528429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-865307c2-22cf-48e9-9059-5081c938c4dc req-6abb6f37-25b1-408a-8f77-cb131b2edc93 service nova] Creating event network-changed:96401a0d-79b1-4f30-8dd7-46c5c4b2731f for instance 701ec119-507b-4b00-b365-bb76f36feab1 on hv-cinder-83009 Mar 08 13:19:54.559082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-865307c2-22cf-48e9-9059-5081c938c4dc req-6abb6f37-25b1-408a-8f77-cb131b2edc93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085150 Mar 08 13:19:54.559368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 72/152] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:19:54.715126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:54.715126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:54.715126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:54.715126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:54.717026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:54.717026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:54.979965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:54.991573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a24d7f32-aa45-4171-8503-7239877d5190 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.305732 Mar 08 13:19:54.992585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 81/153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:54 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:56.009426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:56.010250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:56.016198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:56.016645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:56.017447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:56.017883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:56.155745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:56.163560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b91f94ac-67fb-4556-acd8-1304e4d0e4cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.158324 Mar 08 13:19:56.164168 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 73/154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:56 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:19:57.180550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:57.181896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:57.188747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:57.189260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:57.190036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:57.190469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:57.396603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:57.405499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e1a11c0d-4afc-40a6-8f5d-dc38402e2382 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.228628 Mar 08 13:19:57.406082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 82/155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:57 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:58.421731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:58.422472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:58.429358 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:58.429879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:58.431184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:58.432532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:58.591271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:58.595221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fd785c35-336c-4582-98ef-0ae2ca96eb66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.177284 Mar 08 13:19:58.596025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 74/156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:58 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:58.876523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:58.878114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:58.887696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:58.888363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:58.889401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:58.889834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:58.917081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:19:59.409547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-279b07aa-d357-4812-bdbf-502c52f41f67 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 204 len: 0 microversion: 2.1 time: 0.538914 Mar 08 13:19:59.410353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 83/157] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:19:58 2022] DELETE /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:19:59.427454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:59.427454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:59.427454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:59.427454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:59.428075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:59.428075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:59.574594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:59.582745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a41c4442-b0c8-4bbf-9918-c801a83d0ed4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1553 microversion: 2.1 time: 0.168315 Mar 08 13:19:59.583273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 75/158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:59 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:19:59.613277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:19:59.614030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:19:59.620937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:59.621395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:59.622172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:19:59.622637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:19:59.780564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:19:59.793684 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-053beaaf-ca6a-4978-8cfe-7a19a9b927bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.184553 Mar 08 13:19:59.794286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 84/159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:19:59 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:00.600343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:00.601018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:00.607087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:00.607535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:00.608292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:00.608746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:00.741165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:00.749099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-95b98d7d-78d9-42bc-a095-7d9365fe8b85 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1553 microversion: 2.1 time: 0.152784 Mar 08 13:20:00.751268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 76/160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:00 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:00.811334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:00.811939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:00.818606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:00.819058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:00.820125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:00.820556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:00.969094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:00.977149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-86dd5971-ca56-482d-b8a7-d6e9b007bc8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.169706 Mar 08 13:20:00.977991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 85/161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:00 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:01.771479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:01.771938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:01.779530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:01.780360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:01.781848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:01.782430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:01.930530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:01.939468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6d0234d8-de46-4da2-9c74-04fadfa87bcb tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1553 microversion: 2.1 time: 0.172921 Mar 08 13:20:01.942789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 77/162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:01 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:01.995479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:01.996297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:02.003233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:02.004031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:02.005198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:02.005707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:02.259042 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:02.268268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-16fc6173-1124-41ae-b027-cd0b5b5144df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.277554 Mar 08 13:20:02.270929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 86/163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:01 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:02.788036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-6a6d1f33-dea9-4f8d-ad65-04137fc23834 req-3a6b43b1-f370-4720-8f84-0882837b6794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13664093-145a-4f1d-9ed3-cc61a73ed00b", "name": "network-vif-deleted", "tag": "103e07a3-2988-48cc-8dc9-f04152af20ec"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:02.798375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-6a6d1f33-dea9-4f8d-ad65-04137fc23834 req-3a6b43b1-f370-4720-8f84-0882837b6794 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:02.799348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-6a6d1f33-dea9-4f8d-ad65-04137fc23834 req-3a6b43b1-f370-4720-8f84-0882837b6794 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:02.811604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-6a6d1f33-dea9-4f8d-ad65-04137fc23834 req-3a6b43b1-f370-4720-8f84-0882837b6794 service nova] Creating event network-vif-deleted:103e07a3-2988-48cc-8dc9-f04152af20ec for instance 13664093-145a-4f1d-9ed3-cc61a73ed00b on hv-cinder-83009 Mar 08 13:20:02.817008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-6a6d1f33-dea9-4f8d-ad65-04137fc23834 req-3a6b43b1-f370-4720-8f84-0882837b6794 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Mar 08 13:20:02.817898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 78/164] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:20:02.955899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:02.956545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:02.962942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:02.963695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:02.964695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:02.966379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:03.028919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:03.040854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6c2642d5-1333-46c8-b3a3-e65b4aa2ccab tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1346 microversion: 2.1 time: 0.089226 Mar 08 13:20:03.043236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 87/165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:02 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:03.287469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:03.288187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:03.299862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:03.300319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:03.301134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:03.301600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:03.494519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:03.502215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9881d19a-16df-41bc-bf03-0847cdbea042 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.219197 Mar 08 13:20:03.502788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 79/166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:03 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:04.060389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:04.061135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:04.067777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:04.068226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:04.069040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:04.069477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:04.127316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:04.127970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:04.128563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lazy-loading 'fault' on Instance uuid 13664093-145a-4f1d-9ed3-cc61a73ed00b {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:20:04.174270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eefbc5ad0b94a8db2878c8e45a2a3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ef500d9ef3421eb59d9ce08761298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:04.183820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-36b4de5d-d873-4b9c-a358-22b7af2a28ba tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 200 len: 1351 microversion: 2.1 time: 0.127165 Mar 08 13:20:04.184473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 88/167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:04 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:04.521905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:04.522509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:04.528596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:04.529112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:04.529878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:04.530318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:04.706293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:04.718014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-43969d7c-e6b3-4e06-9077-b86c29333a7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.200621 Mar 08 13:20:04.718747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 80/168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:04 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:05.200792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:05.201399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:05.207833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:05.208277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:05.209061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:05.209488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:05.222714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] HTTP exception thrown: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. Mar 08 13:20:05.223341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Returning 404 to user: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:20:05.224355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fa33af17-2cbd-4e1e-8800-2b0be5b1d83d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 404 len: 111 microversion: 2.1 time: 0.027478 Mar 08 13:20:05.224951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 89/169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:05 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:20:05.328956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:05.329862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:05.335965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:05.336532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:05.337641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:05.338082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:05.351848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] HTTP exception thrown: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. Mar 08 13:20:05.352865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Returning 404 to user: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:20:05.353695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e558194d-0e7c-4b6e-b578-bf136821699d tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028805 Mar 08 13:20:05.354239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 81/170] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:20:05 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:20:05.744571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:05.745443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:05.753485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:05.754416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:05.755857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:05.756543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:05.905548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:05.913969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ef906c03-e9c6-4785-a242-c748c45fdacf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.178146 Mar 08 13:20:05.914669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 90/171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:05 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:06.797510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:06.798003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:06.804314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:06.804789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:06.805601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:06.806039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:06.819022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] HTTP exception thrown: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. Mar 08 13:20:06.819602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Returning 404 to user: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:20:06.820542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f853dcef-80a6-41bb-a6c0-af4592bbc7d4 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 404 len: 111 microversion: 2.1 time: 0.026880 Mar 08 13:20:06.821105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 82/172] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:20:06 2022] DELETE /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:20:06.828896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:06.829545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] [instance: 13664093-145a-4f1d-9ed3-cc61a73ed00b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:06.835850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:06.836298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:06.837088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:06.837522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:06.850885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] HTTP exception thrown: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. Mar 08 13:20:06.851557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] Returning 404 to user: Instance 13664093-145a-4f1d-9ed3-cc61a73ed00b could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:20:06.852604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-56b27d2f-70ac-40e4-97f8-dfc02ec26de0 tempest-DeleteServersTestJSON-2053315702 tempest-DeleteServersTestJSON-2053315702-project] 10.222.0.52 "GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b" status: 404 len: 111 microversion: 2.1 time: 0.027242 Mar 08 13:20:06.853163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 91/173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:06 2022] GET /compute/v2.1/servers/13664093-145a-4f1d-9ed3-cc61a73ed00b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:20:06.931349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:06.931991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:06.937703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:06.938146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:06.938899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:06.939330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:07.127461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:07.135572 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9b8908ac-a8fa-448e-8783-c2e8a490d6be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.208067 Mar 08 13:20:07.136146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 83/174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:06 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:08.153180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:08.153797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:08.159943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:08.161231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:08.161994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:08.162430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:08.308433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:08.315992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6e7cb2e2-573a-45fc-bc8b-ea28994b89cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.166659 Mar 08 13:20:08.323671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 92/175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:08 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:09.335135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:09.336306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:09.345758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:09.350234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:09.355136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:09.355584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:09.574013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:09.584791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a809af0d-15aa-436d-a2b3-ca6cd94d9f45 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.254713 Mar 08 13:20:09.589128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 84/176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:09 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:10.605871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:10.606733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:10.608266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5bb46a84-8410-47f6-bda8-6a2f6063d106 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Action: 'create', calling method: .version_select at 0x7f5e2d5e1b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-90590647", "metadata": {"Type": "work"}}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:10.612872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:10.613318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:10.614079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:10.617822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:10.863575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:10.880129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f1ff073-d92b-4222-8d81-4c8341c4a53f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.278447 Mar 08 13:20:10.883309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 85/177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:10 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:20:11.539789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5bb46a84-8410-47f6-bda8-6a2f6063d106 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.304553 Mar 08 13:20:11.543231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 93/178] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Mar 8 13:20:10 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 1306 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 13:20:11.556334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1d3f5fda-0dd6-4d34-9cb6-942889bcf648 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Calling method '.version_select at 0x7f5e2d630310>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:11.777794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1d3f5fda-0dd6-4d34-9cb6-942889bcf648 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad" status: 200 len: 351 microversion: 2.1 time: 0.228771 Mar 08 13:20:11.778439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 86/179] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:20:11 2022] GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad => generated 351 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:20:11.899820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:11.900991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:11.907347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:11.907792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:11.908565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:11.909025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:12.046355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:12.053714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aee1ab60-6ff6-4cd8-b02a-4d6426c434e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.157672 Mar 08 13:20:12.054377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 94/180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:11 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:12.790372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-992d5a58-f910-4ff7-9d27-ecbc51ebd760 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Calling method '.version_select at 0x7f5e2defb940>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:12.842085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-992d5a58-f910-4ff7-9d27-ecbc51ebd760 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad" status: 200 len: 352 microversion: 2.1 time: 0.055674 Mar 08 13:20:12.842658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 87/181] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:20:12 2022] GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:20:12.854900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-67a019b6-a3d8-4d01-bada-853c76a32e34 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Calling method '.version_select at 0x7f5e2f0e8670>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:12.920181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-67a019b6-a3d8-4d01-bada-853c76a32e34 tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad" status: 200 len: 352 microversion: 2.1 time: 0.069052 Mar 08 13:20:12.921010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 95/182] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:20:12 2022] GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:20:12.938051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-79c274c0-7095-4050-b8c5-f5d49ec911db tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Calling method '.version_select at 0x7f5e2d6ae700>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:13.071360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:13.072243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:13.078627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:13.079423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:13.080232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:13.080911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:13.224158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-79c274c0-7095-4050-b8c5-f5d49ec911db tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad" status: 202 len: 0 microversion: 2.1 time: 0.290113 Mar 08 13:20:13.224810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 88/183] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:20:12 2022] DELETE /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:20:13.232991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fe70abf9-b9c0-4bdc-b9d9-42e390f204ba tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Calling method '.version_select at 0x7f5e2d630310>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:13.269010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:13.277014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a609622a-ee27-48f8-a669-a83705fcea66 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.210593 Mar 08 13:20:13.280446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 96/184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:13 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:20:13.289821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fe70abf9-b9c0-4bdc-b9d9-42e390f204ba tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad" status: 200 len: 351 microversion: 2.1 time: 0.060526 Mar 08 13:20:13.290390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 89/185] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:20:13 2022] GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:20:14.303223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-811d91a1-f5bd-4bbe-8c6a-a2c34475967b tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Calling method '.version_select at 0x7f5e2df16820>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:14.303778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:14.303778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:14.311118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:14.311782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:14.312620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:14.313093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:14.465887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:14.473273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-04423098-4c54-4117-ad83-10e93ebb84db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.181355 Mar 08 13:20:14.473831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 97/186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:14 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:14.922987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-811d91a1-f5bd-4bbe-8c6a-a2c34475967b tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] HTTP exception thrown: Volume 426a9b16-a3a6-4578-b70c-62702442f4ad could not be found. Mar 08 13:20:14.923784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-811d91a1-f5bd-4bbe-8c6a-a2c34475967b tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] Returning 404 to user: Volume 426a9b16-a3a6-4578-b70c-62702442f4ad could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:20:14.924852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-811d91a1-f5bd-4bbe-8c6a-a2c34475967b tempest-VolumesGetTestJSON-1924935096 tempest-VolumesGetTestJSON-1924935096-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad" status: 404 len: 109 microversion: 2.1 time: 0.626630 Mar 08 13:20:14.926455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 90/187] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:20:14 2022] GET /compute/v2.1/os-volumes/426a9b16-a3a6-4578-b70c-62702442f4ad => generated 109 bytes in 629 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:20:15.493018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:15.494603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:15.501736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:15.502427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:15.504612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:15.505547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:15.683962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:15.693362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-86301e5e-fce4-42ea-b381-bf47c21e626e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.206492 Mar 08 13:20:15.695111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 98/188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:15 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:16.716451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:16.716451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:16.725721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:16.726174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:16.729068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:16.730459 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:16.917252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:16.927646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-498fffed-d392-436d-b975-f1cebeb9c9eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1522 microversion: 2.1 time: 0.219321 Mar 08 13:20:16.937851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 91/189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:16 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:17.946446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:17.947592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:17.958970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:17.959409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:17.960376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:17.961022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:18.149429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:18.164744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c6f49fd6-e4eb-480e-a195-b4d937fbed49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1502 microversion: 2.1 time: 0.224117 Mar 08 13:20:18.166682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 99/190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:17 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:18.210664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:18.211274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:18.216983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:18.217440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:18.218210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:18.218644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:18.379439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:18.388089 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-02d16438-9ed0-4c9a-8ec7-1bdbda9a7eff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1516 microversion: 2.1 time: 0.181171 Mar 08 13:20:18.388686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 92/191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:20.695677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:20.696650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:20.702867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:20.703314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:20.704093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:20.704527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:20.726724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lazy-loading 'flavor' on Instance uuid dd6bc389-6db6-4800-b030-7ee0a855e6de {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:20:21.085572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e9b3b691-ffbb-4f89-b4fa-516ab879b64d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action" status: 200 len: 32 microversion: 2.1 time: 0.393606 Mar 08 13:20:21.087307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 100/192] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:20:20 2022] POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action => generated 32 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 13:20:21.096319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:21.098179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:21.105539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:21.110362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:21.110362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:21.110362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:21.356005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:21.363335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-78c9a26e-f2aa-4403-aa10-8ff8f1d830ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.271008 Mar 08 13:20:21.364064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 93/193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:22.381895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:22.382740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:22.388984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:22.389431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:22.390222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:22.390634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:22.548984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:22.556465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a728a598-b9a3-4216-95aa-adeb44dabb7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.179656 Mar 08 13:20:22.557091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 101/194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:23.573923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:23.574534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:23.581339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:23.582332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:23.583199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:23.583636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:23.724945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:23.732371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9e3ccd15-fc2d-4533-bade-0c3b2a1c9154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.162749 Mar 08 13:20:23.732966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 94/195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:23.972646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1202880086", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "networks": [{"uuid": "f5aad395-b5ce-409d-8195-3c041598c0a7"}]}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:24.026685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] validate_networks() for [('f5aad395-b5ce-409d-8195-3c041598c0a7', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:20:24.411426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:20:24.411860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:20:24.412337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:20:24.412874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:20:24.413292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:20:24.422800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:24.423433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:24.424236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:24.424688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:24.443080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Getting quotas for project 79b5b498a60248d3aedb25d879c5c923. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:20:24.447168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Getting quotas for user 5f1befc68f5a43c492efef77b1ec480a and project 79b5b498a60248d3aedb25d879c5c923. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:20:24.459351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:20:24.461842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:20:24.592706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0103cad2-d363-44ad-b1f2-9f7979c4ea05 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623989 Mar 08 13:20:24.593875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 102/196] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:20:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:20:24.605046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-13890fce-7b61-43e8-b87a-074c9c36693a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:24.605654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-13890fce-7b61-43e8-b87a-074c9c36693a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:24.674945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-13890fce-7b61-43e8-b87a-074c9c36693a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:24.682586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-13890fce-7b61-43e8-b87a-074c9c36693a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1219 microversion: 2.1 time: 0.081805 Mar 08 13:20:24.683161 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 95/197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:24 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:24.760744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:24.761978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:24.769848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:24.770636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:24.771585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:24.773378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:24.918974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:24.928999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7c686e75-4b6a-4997-9a42-4c06b0534542 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.182610 Mar 08 13:20:24.929577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 103/198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:25.700433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5155595e-1acd-4466-9896-17de60dc658c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:25.701646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5155595e-1acd-4466-9896-17de60dc658c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:25.754266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5155595e-1acd-4466-9896-17de60dc658c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:25.761374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5155595e-1acd-4466-9896-17de60dc658c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1219 microversion: 2.1 time: 0.065364 Mar 08 13:20:25.761918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 96/199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:25 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:25.945354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:25.945982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:25.952266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:25.952753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:25.953521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:25.953954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:26.086612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:26.094292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8c3ff3e1-747f-457d-a9bf-7d6b517bb5d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.152801 Mar 08 13:20:26.094944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 104/200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:26.778575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:26.779243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:26.785456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:26.787805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:26.787805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:26.787805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:26.847773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:26.855246 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-83bbf5a9-44d3-4a6a-8b7e-0a49ddd15fa8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1223 microversion: 2.1 time: 0.080566 Mar 08 13:20:26.855833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 97/201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:26 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:27.111893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:27.113149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:27.120487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:27.120946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:27.121724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:27.122439 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:27.306308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:27.312044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4e41419c-11da-4663-b023-eb86f58cd205 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.204018 Mar 08 13:20:27.312627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 105/202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:27.872481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:27.873127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:27.879080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:27.879534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:27.880297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:27.880767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:27.946617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:27.955801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-125f35ff-8704-4d91-b39b-ada582979c61 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1271 microversion: 2.1 time: 0.087089 Mar 08 13:20:27.956423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 98/203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:27 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:28.329887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:28.330559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:28.337834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:28.343573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:28.343573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:28.343573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:28.482579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:28.490610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-78af9aff-a182-4cd7-92ec-784736701f6e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.164578 Mar 08 13:20:28.495619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 106/204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:28.973450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:28.974185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:28.980308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:28.984559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:28.984559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:28.984559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:29.045645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:29.055949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d08e7a72-79a8-4d9a-ac10-ef060d2efb24 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1271 microversion: 2.1 time: 0.084518 Mar 08 13:20:29.055949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 99/205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:28 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:29.510220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:29.510832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:29.517937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:29.518391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:29.520557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:29.521063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:29.682673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:29.690406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-07f8d4b1-7a61-49d7-a1e5-5c61389b00c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.183896 Mar 08 13:20:29.695255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 107/206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:30.070633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:30.071968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:30.077861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:30.078886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:30.079431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:30.080012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:30.149618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:30.157472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-45a87d10-7ab7-4dfe-a49e-5fca7def8010 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1271 microversion: 2.1 time: 0.091176 Mar 08 13:20:30.158032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 100/207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:30 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:30.710426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:30.711031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:30.717355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:30.717810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:30.718569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:30.719006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:30.912198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:30.921893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5b066105-f097-4d80-81b4-c4f2c9e64b5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.215337 Mar 08 13:20:30.922713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 108/208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:31.177691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:31.178325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:31.184424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:31.188652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:31.188652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:31.188652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:31.247570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:31.255754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3c7e9c2d-d564-4bc5-8bbc-c8e2f2a1ecd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1279 microversion: 2.1 time: 0.084413 Mar 08 13:20:31.256328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 101/209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:31 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:31.939390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:31.942735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:31.947709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:31.948169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:31.949154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:31.949601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:32.091194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:32.099247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0e37967c-50ff-4e0f-83f5-06e8532deedd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.163728 Mar 08 13:20:32.099803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 109/210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:32.273592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:32.274203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:32.279922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:32.280368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:32.281162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:32.281593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:32.342142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:32.351495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-323568c1-eb06-4e21-a6f1-a52e62bae295 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1279 microversion: 2.1 time: 0.082408 Mar 08 13:20:32.352467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 102/211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:32 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:33.116976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:33.117594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:33.123758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:33.124212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:33.125009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:33.125444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:33.370342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:33.370874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:33.377177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:33.377374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:33.378033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:33.379407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:33.380040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:33.390748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d87afe09-862b-4703-910d-34a094952ef3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.277612 Mar 08 13:20:33.391464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 110/212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:33.474995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:33.485711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c5061a43-53bd-48b9-a899-834f8c8598f6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1279 microversion: 2.1 time: 0.119548 Mar 08 13:20:33.492350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 103/213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:33 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:34.408637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:34.409297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:34.416473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:34.417173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:34.418482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:34.419244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:34.510641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:34.511507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:34.521896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:34.522299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:34.523100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:34.523543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:34.759411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:34.776975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-452e3865-ccdf-42c3-a8c0-dac61b500dda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.363909 Mar 08 13:20:34.780890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 111/214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:34.988747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:34.997939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6f04eede-3af9-4da7-9fc1-e4a9004a8d86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.492960 Mar 08 13:20:34.999065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 104/215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:34 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:35.565693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-7266840e-cd22-4c79-8788-ec62402d1acc req-7767f665-137a-4d7f-96ef-506c885c1244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb7cf51-102c-4301-941a-338b211f4ddb", "tag": "9c21a2e3-13f5-49d4-b60f-429cf89734dd"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:35.584741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-7266840e-cd22-4c79-8788-ec62402d1acc req-7767f665-137a-4d7f-96ef-506c885c1244 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:35.585189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-7266840e-cd22-4c79-8788-ec62402d1acc req-7767f665-137a-4d7f-96ef-506c885c1244 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:35.601987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-7266840e-cd22-4c79-8788-ec62402d1acc req-7767f665-137a-4d7f-96ef-506c885c1244 service nova] Creating event network-changed:9c21a2e3-13f5-49d4-b60f-429cf89734dd for instance 3bb7cf51-102c-4301-941a-338b211f4ddb on hv-cinder-83009 Mar 08 13:20:35.609465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-7266840e-cd22-4c79-8788-ec62402d1acc req-7767f665-137a-4d7f-96ef-506c885c1244 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048877 Mar 08 13:20:35.610369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 112/216] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:20:35.799320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:35.799788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:35.809390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:35.810934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:35.811837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:35.812338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:36.021911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:36.022895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:36.047832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:36.048582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:36.049546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:36.050132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:36.181353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:36.189054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8a45cc9e-7ff3-4020-b045-8b264aa4126d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1522 microversion: 2.1 time: 0.393704 Mar 08 13:20:36.200199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 105/217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:36.352879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:36.360892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f6b3398-701d-45f1-8276-f609703b0c13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.343127 Mar 08 13:20:36.371045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 113/218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:36 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:20:37.207312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:37.209262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:37.215711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.216640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:37.218104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.218865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:37.379544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:37.380526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:37.388174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.388989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:37.390007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.390644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:37.546329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:37.561492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0b923cfd-c9a6-4b96-8210-c586e05ac823 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.186498 Mar 08 13:20:37.572325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 114/219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:37 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:20:37.730729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:37.756584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-00f6c697-bb56-45c0-bdc3-4b673c7c6bb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1502 microversion: 2.1 time: 0.554366 Mar 08 13:20:37.758558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 106/220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1502 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:37.773993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09bd6639-b7b2-419b-b3b1-73f47660db7a"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:37.779902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:37.788937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.790690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:37.791671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.792572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:37.825282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] HTTP exception thrown: Cannot 'attach_volume' instance dd6bc389-6db6-4800-b030-7ee0a855e6de while it is in vm_state rescued Mar 08 13:20:37.825879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Returning 409 to user: Cannot 'attach_volume' instance dd6bc389-6db6-4800-b030-7ee0a855e6de while it is in vm_state rescued {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:20:37.826719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee2f980a-8c5f-45a6-b15f-312821321b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057708 Mar 08 13:20:37.827326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 115/221] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:20:37 2022] POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 08 13:20:37.837134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2cc54644-af3e-454c-8ed5-d6d759cb5213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:37.837898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2cc54644-af3e-454c-8ed5-d6d759cb5213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:37.844059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cc54644-af3e-454c-8ed5-d6d759cb5213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.844505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cc54644-af3e-454c-8ed5-d6d759cb5213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:37.845492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cc54644-af3e-454c-8ed5-d6d759cb5213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:37.845924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cc54644-af3e-454c-8ed5-d6d759cb5213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:38.143779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2cc54644-af3e-454c-8ed5-d6d759cb5213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action" status: 202 len: 0 microversion: 2.1 time: 0.311306 Mar 08 13:20:38.147594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 107/222] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:20:37 2022] POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 13:20:38.153055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:38.154119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:38.160914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:38.161537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:38.162392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:38.162917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:38.337710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:38.350278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d309ab49-474e-4198-b1cc-7e054f167f4e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1510 microversion: 2.1 time: 0.201263 Mar 08 13:20:38.351462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 116/223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:20:38.579767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:38.581240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:38.589377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:38.590031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:38.595033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:38.595033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:38.975471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:38.983811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-df96fd7a-b9ad-4c14-949a-c90e67b61dc6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.408143 Mar 08 13:20:38.984377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 108/224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:38 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:39.368424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:39.370168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:39.382455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:39.383367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:39.383667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:39.384095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:39.534723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:39.543298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e57001e3-a1f5-467e-a22a-56bb1207e870 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1510 microversion: 2.1 time: 0.179533 Mar 08 13:20:39.543989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 117/225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:40.001232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:40.002933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:40.010496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:40.011164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:40.012151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:40.012749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:40.179300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:40.187136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-188bf723-caf3-498c-a64f-c0f59fa9bb23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.190863 Mar 08 13:20:40.187707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 109/226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:39 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:40.561257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:40.562175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:40.569350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:40.569909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:40.570928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:40.571420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:40.721054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:40.729012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ca31e0aa-3061-4ab9-b761-fce4849bb82c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1510 microversion: 2.1 time: 0.171920 Mar 08 13:20:40.729655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 118/227] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:41.205218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:41.206136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:41.213433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:41.214095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:41.215024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:41.215887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:41.453134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:41.463774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4f6cab5c-cae5-40d2-bd45-49dd79d82878 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.262345 Mar 08 13:20:41.464522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 110/228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:41 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:41.765176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:41.769265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:41.792241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:41.793098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:41.794517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:41.795343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:42.041260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:42.048498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ebb5a763-84fe-4c1e-b920-245e5df064a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1516 microversion: 2.1 time: 0.300960 Mar 08 13:20:42.049125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 119/229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:42.481654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:42.482395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:42.493712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:42.498654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:42.501768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:42.503406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:42.768222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:42.776149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dcbe082e-33ed-4963-8cca-0a55665ddf51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.299083 Mar 08 13:20:42.781064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 111/230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:43.798138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:43.798138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:43.805432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:43.805897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:43.806793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:43.807234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:44.060397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:44.069315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f875aaef-36d2-4fe0-931c-931510777ead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.279490 Mar 08 13:20:44.079137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 120/231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:43 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:44.258163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:44.259401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:44.268052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:44.271795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:44.273009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:44.275205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:44.501704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:44.510533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1815d021-a6c2-44ca-aa25-54370b541321 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1516 microversion: 2.1 time: 0.258759 Mar 08 13:20:44.511125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 112/232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:44.528306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b3275dac-5e46-43c6-899f-7ac7f0067ac2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61eea3fb-a4e3-4b07-83de-10ec7479bea1"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:44.529323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b3275dac-5e46-43c6-899f-7ac7f0067ac2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:44.540347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3275dac-5e46-43c6-899f-7ac7f0067ac2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:44.541019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3275dac-5e46-43c6-899f-7ac7f0067ac2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:44.541894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3275dac-5e46-43c6-899f-7ac7f0067ac2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:44.542398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3275dac-5e46-43c6-899f-7ac7f0067ac2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:45.038966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-1a4801b0-074a-42c7-a057-8e3988a7fc22 req-44a3a3f0-cf47-4505-83fd-9dfd7ea63a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb7cf51-102c-4301-941a-338b211f4ddb", "name": "network-vif-plugged", "status": "completed", "tag": "9c21a2e3-13f5-49d4-b60f-429cf89734dd"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:45.048452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-1a4801b0-074a-42c7-a057-8e3988a7fc22 req-44a3a3f0-cf47-4505-83fd-9dfd7ea63a71 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:45.049242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-1a4801b0-074a-42c7-a057-8e3988a7fc22 req-44a3a3f0-cf47-4505-83fd-9dfd7ea63a71 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:45.066537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-1a4801b0-074a-42c7-a057-8e3988a7fc22 req-44a3a3f0-cf47-4505-83fd-9dfd7ea63a71 service nova] Creating event network-vif-plugged:9c21a2e3-13f5-49d4-b60f-429cf89734dd for instance 3bb7cf51-102c-4301-941a-338b211f4ddb on hv-cinder-83009 Mar 08 13:20:45.078865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-1a4801b0-074a-42c7-a057-8e3988a7fc22 req-44a3a3f0-cf47-4505-83fd-9dfd7ea63a71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043643 Mar 08 13:20:45.080167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 113/233] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:20:45.091562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:45.091562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:45.111369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:45.112051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:45.120199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:45.121233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:45.421526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:45.429064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a90b0bd-76cf-4388-9b7a-7a19d8fa28af tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.344627 Mar 08 13:20:45.438262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 114/234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:45 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:45.438262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-81262324-2201-4c86-997a-cc1c6236087c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:45.438262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-81262324-2201-4c86-997a-cc1c6236087c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:45.442009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-81262324-2201-4c86-997a-cc1c6236087c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:45.442463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-81262324-2201-4c86-997a-cc1c6236087c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:45.443292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-81262324-2201-4c86-997a-cc1c6236087c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:45.443785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-81262324-2201-4c86-997a-cc1c6236087c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:45.472963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-81262324-2201-4c86-997a-cc1c6236087c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/ips" status: 200 len: 150 microversion: 2.20 time: 0.041782 Mar 08 13:20:45.473614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 115/235] 10.222.0.52 () {60 vars in 1288 bytes} [Tue Mar 8 13:20:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:20:45.696084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b3275dac-5e46-43c6-899f-7ac7f0067ac2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171565 Mar 08 13:20:45.697213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 121/236] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:20:44 2022] POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 194 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:20:46.448318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:46.449759 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:46.456923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:46.457567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:46.459904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:46.460498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:46.697458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:46.707555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cd1be077-9464-4987-9da4-5b3280ce0f38 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1319 microversion: 2.1 time: 0.263843 Mar 08 13:20:46.709115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 116/237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:46 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:47.728532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:47.729382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:47.742474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:47.743932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:47.744982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:47.745958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:48.006269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:48.014793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-adef39a5-ecb6-48ba-8242-d37ef75e9e34 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1509 microversion: 2.1 time: 0.293604 Mar 08 13:20:48.015374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 122/238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:47 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:49.055733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:49.056402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:49.062955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:49.063404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:49.064212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:49.064646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:49.093201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lazy-loading 'flavor' on Instance uuid 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:20:49.171633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-94c309b6-e9b2-461a-8ed9-e38ced936465 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Action: 'create', calling method: .version_select at 0x7f5e2defb430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1996988874"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:49.190133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-94c309b6-e9b2-461a-8ed9-e38ced936465 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Getting quotas for project 52fda171a20f4fe3b366624e9c26e12a. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:20:49.193774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-94c309b6-e9b2-461a-8ed9-e38ced936465 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Getting quotas for user f98c597d9e1a45e7bd8267b730a0b84b and project 52fda171a20f4fe3b366624e9c26e12a. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:20:49.670113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-94c309b6-e9b2-461a-8ed9-e38ced936465 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Getting quotas for project 52fda171a20f4fe3b366624e9c26e12a. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:20:49.673790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-94c309b6-e9b2-461a-8ed9-e38ced936465 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Getting quotas for user f98c597d9e1a45e7bd8267b730a0b84b and project 52fda171a20f4fe3b366624e9c26e12a. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:20:49.686650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-94c309b6-e9b2-461a-8ed9-e38ced936465 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.712767 Mar 08 13:20:49.687251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 117/239] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:20:48 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:49.725404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a3f24cd8-f86f-4ac5-be05-3f88a0832cc7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/action" status: 202 len: 0 microversion: 2.20 time: 0.674168 Mar 08 13:20:49.726125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 123/240] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Mar 8 13:20:49 2022] POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/action => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 13:20:49.734455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:49.735064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:49.741167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:49.741631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:49.742461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:49.742896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:49.905708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:49.917194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:49.919475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:49.920722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4963fd41-0ad5-4293-bb43-758e4d1bf566 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.190092 Mar 08 13:20:49.921764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 118/241] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:20:50.941192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:50.942069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:50.949605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:50.950283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:50.951222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:50.951811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:51.233683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:51.233683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:51.234147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:51.234147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e4288bfd-30c1-468b-b6d0-193230c97a64 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.256600 Mar 08 13:20:51.234147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 124/242] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:20:52.244011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:52.251648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:52.260471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:52.261015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:52.266369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:52.266369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:52.491769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:52.501023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:52.507796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:52.507796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-61cf2cd3-c7f9-448c-bbb1-d7a8572b580b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.264381 Mar 08 13:20:52.514838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 119/243] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:20:53.128461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a29cc1b0-7d86-446f-816a-8fd5e979a171 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:53.129783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a29cc1b0-7d86-446f-816a-8fd5e979a171 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:53.137006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a29cc1b0-7d86-446f-816a-8fd5e979a171 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:53.137494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a29cc1b0-7d86-446f-816a-8fd5e979a171 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:53.138275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a29cc1b0-7d86-446f-816a-8fd5e979a171 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:53.138759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a29cc1b0-7d86-446f-816a-8fd5e979a171 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:53.164533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a29cc1b0-7d86-446f-816a-8fd5e979a171 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/ips" status: 200 len: 149 microversion: 2.1 time: 0.055697 Mar 08 13:20:53.171152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 125/244] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:20:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:20:53.522375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:53.523054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:53.529877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:53.530322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:53.531081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:53.531508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:53.678821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:53.687410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:53.689130 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:53.690319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d028514d-4fc9-425a-8c51-1847f98e460d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.171833 Mar 08 13:20:53.691021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 120/245] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:20:54.709303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:54.709996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:54.716941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:54.717353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:54.718229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:54.718545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:54.858676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:54.877427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:54.878934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:54.880111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e05935a6-5e97-4c07-8b5d-d1b1849fbe11 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.175258 Mar 08 13:20:54.880740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 126/246] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:20:55.301746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:55.302738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:55.309005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:55.309847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:55.314453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:55.315166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:55.346288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lazy-loading 'flavor' on Instance uuid dd6bc389-6db6-4800-b030-7ee0a855e6de {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:20:55.740522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3e8ad089-aa72-4d0c-8926-1c632a1fe84d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action" status: 200 len: 32 microversion: 2.1 time: 0.443633 Mar 08 13:20:55.741203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 121/247] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:20:55 2022] POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action => generated 32 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 13:20:55.750734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:55.751384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:55.757705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:55.758165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:55.758922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:55.759910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:55.904772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:55.905469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:55.912414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:55.912414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:55.912683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:55.913159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:55.913454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:55.922568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-87d08cd5-f196-419d-b485-2f4e9f574553 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.175532 Mar 08 13:20:55.923322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 127/248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:56.054121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:56.062492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:56.063990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:56.065196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8a8eea03-982d-4d03-b51c-8f8ff783601f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.165533 Mar 08 13:20:56.065756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 122/249] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:20:56.941114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:56.941784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:56.949936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:56.950689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:56.952002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:56.952607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:57.086552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:57.090880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:57.094169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:57.094827 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:57.095908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:57.096691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:57.102374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:57.110663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8df06f73-05f2-4a42-a2d9-7d237db47f34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.173855 Mar 08 13:20:57.111232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 128/250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:20:57.287435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:57.295147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:57.296636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:57.297805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6d14ce71-7541-41d8-af83-0f2b23dcad4f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.216142 Mar 08 13:20:57.298358 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 123/251] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:20:57.768478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d3b7c919-68b3-45b4-bff8-d3ce4aa94bbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "314c5589-7a57-4a18-a54e-0c7841dd6600"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:20:57.769759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d3b7c919-68b3-45b4-bff8-d3ce4aa94bbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:57.775992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3b7c919-68b3-45b4-bff8-d3ce4aa94bbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:57.776427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3b7c919-68b3-45b4-bff8-d3ce4aa94bbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:57.777321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3b7c919-68b3-45b4-bff8-d3ce4aa94bbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:57.777839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3b7c919-68b3-45b4-bff8-d3ce4aa94bbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:58.127271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:58.127867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:58.133762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:58.134204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:58.134957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:58.135388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:58.282534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:58.290383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-63031d2b-2e9a-40be-9b7e-e39f1643fbce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.166967 Mar 08 13:20:58.291085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 124/252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:20:58.316103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:58.316750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:58.324061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:58.324510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:58.325333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:58.326593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:58.464383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:58.473329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:58.475124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:58.476365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-253a77d9-ce4c-4998-b189-55d5463b49af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.164195 Mar 08 13:20:58.477179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 125/253] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:20:59.308051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:59.308735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:59.314481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:59.314925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:59.315680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:59.316112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:59.452705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:59.460434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-05debe1b-52b7-45cd-bd62-79edc2c29f4b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.156482 Mar 08 13:20:59.461019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 126/254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:20:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:20:59.496379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:20:59.497006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:20:59.502734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:59.503177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:59.503928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:20:59.504357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:20:59.643481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:59.651685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:59.653386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:20:59.654609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-721cbf69-b6b8-47a8-a56d-6c2deaed2ffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.162007 Mar 08 13:20:59.655235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 127/255] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:20:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:00.477834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:00.478485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:00.485064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:00.485510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:00.486276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:00.486711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:00.634686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:00.642608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9fafcdda-9c89-498f-854a-1b88b75ba268 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.168769 Mar 08 13:21:00.643266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 128/256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:00.673436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:00.674072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:00.679812 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:00.683018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:00.683018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:00.683018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:00.826142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:00.834104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:00.835697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:00.836881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fe36dae7-8dab-4776-b688-6e9772941568 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.167575 Mar 08 13:21:00.837443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 129/257] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:00 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:00.893788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d3b7c919-68b3-45b4-bff8-d3ce4aa94bbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.129086 Mar 08 13:21:00.894451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 129/258] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:20:57 2022] POST /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 194 bytes in 3131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:01.660598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:01.661227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:01.667465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:01.670598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:01.670598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:01.670598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:01.816002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:01.828477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-53a13761-0b30-46d8-bafe-4cbbf76024a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.166833 Mar 08 13:21:01.828477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 130/259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:01.859813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:01.860979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:01.870705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:01.873654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:01.873654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:01.873654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:02.090902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:02.100552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:02.109959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:02.111757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8bc4fb84-7635-418a-82e4-fd2e99a59290 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.259795 Mar 08 13:21:02.112706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 130/260] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:02.841902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:02.842421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:02.848352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:02.848985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:02.849666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:02.850105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:03.003225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:03.013945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8ea077ab-bd12-48eb-b426-82e7c7fd3201 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.175939 Mar 08 13:21:03.015039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 131/261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:03.131461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:03.132072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:03.138734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:03.139255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:03.140140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:03.140642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:03.285480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:03.311547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:03.313010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:03.314172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-332dd33c-dd8c-4e97-ac43-6a49571f274b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.186771 Mar 08 13:21:03.314733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 131/262] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:04.034045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:04.034661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:04.040541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:04.041092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:04.041880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:04.042490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:04.241188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:04.255396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-287ffa4e-c658-47a7-87fd-fefd791fc810 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.224789 Mar 08 13:21:04.256385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 132/263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:04.332458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:04.333210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:04.339198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:04.339699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:04.340465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:04.340924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:04.483958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:04.491649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:04.493175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:04.494328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3dece15e-4389-4c9a-a0fd-8bd4594b89c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.165792 Mar 08 13:21:04.494888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 132/264] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:05.278501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:05.279426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:05.287445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:05.288256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:05.289221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:05.289654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:05.429596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:05.437915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f96f0a53-476e-4b4f-b15b-763c8658734d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.165561 Mar 08 13:21:05.438665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 133/265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:05.513715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:05.514324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:05.520490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:05.520979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:05.526960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:05.526960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:05.680952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:05.692825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:05.694929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:05.697867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-568b6d92-a01c-44df-85cc-e77a7da62ca6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.188482 Mar 08 13:21:05.700413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 133/266] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:06.460431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:06.461020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:06.467370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:06.468041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:06.468859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:06.469291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:06.605678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:06.614333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ed8c8dcc-05bb-4ede-a8c1-d227dcaae539 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.158146 Mar 08 13:21:06.614907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 134/267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:06.717967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:06.718499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:06.724761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:06.725216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:06.725984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:06.726424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:06.863624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:06.871436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:06.874196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:06.877547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bab49ae5-3cd4-4abb-a4cf-6237a44e9384 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.162152 Mar 08 13:21:06.877547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 134/268] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:07.631445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:07.632079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:07.638074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:07.638653 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:07.641947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:07.641947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:07.782034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:07.789855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dbb3568e-0fff-4374-9485-1bc8fa0a5d0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.162333 Mar 08 13:21:07.792415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 135/269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:07.895841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:07.896885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:07.904054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:07.904506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:07.905464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:07.905903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:08.047747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:08.055870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:08.057467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:08.058637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b506d544-64f9-44df-8c90-f265b84cbaf3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.167430 Mar 08 13:21:08.059196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 135/270] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:07 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:08.807400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:08.808069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:08.815125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:08.815568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:08.816343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:08.816811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:08.950181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:08.960013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d382631d-18ae-4ccd-97da-5fe3d3a96a0a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.156458 Mar 08 13:21:08.960774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 136/271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:09.078072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:09.078590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:09.087470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:09.088254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:09.089666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:09.090452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:09.236469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:09.247264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:09.249541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:09.250715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ec466877-e89c-45bf-98ef-f922bf3b052c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.176985 Mar 08 13:21:09.251279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 136/272] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:09.478832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d40db925-6c3f-4992-b3b6-19593a7adf52 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: .version_select at 0x7f5e2df43280>, body: {"keypair": {"name": "tempest-keypair-256273803"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:09.493634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-d40db925-6c3f-4992-b3b6-19593a7adf52 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:21:09.497488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-d40db925-6c3f-4992-b3b6-19593a7adf52 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:21:09.649446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-d40db925-6c3f-4992-b3b6-19593a7adf52 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:21:09.652918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-d40db925-6c3f-4992-b3b6-19593a7adf52 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:21:09.666200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d40db925-6c3f-4992-b3b6-19593a7adf52 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.191341 Mar 08 13:21:09.666784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 137/273] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:21:09 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:09.978944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:09.979548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:09.985854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:09.986332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:09.987092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:09.987525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:10.121416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:10.129942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5e75fa92-b579-42e2-9df8-e80cc535ecba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.155072 Mar 08 13:21:10.130727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 137/274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:10.269127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:10.269746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:10.275657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:10.276108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:10.276913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:10.277355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:10.437511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:10.445333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:10.446856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:10.448021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1629944b-3b44-4e22-a5ec-b3a74a4770af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.183020 Mar 08 13:21:10.448559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 138/275] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:10 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:11.147261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:11.151679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:11.154494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:11.154949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:11.155717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:11.156147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:11.296859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:11.308471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3ffeaff2-691c-4e6e-9f52-b88faab1e2a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.164926 Mar 08 13:21:11.309006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 138/276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:11.466979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:11.467741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:11.473973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:11.474491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:11.475400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:11.475931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:11.646723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:11.655169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:11.656677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:11.657818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2f642a68-c857-4ea6-b4bd-508498645f86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.195071 Mar 08 13:21:11.658383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 139/277] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:12.027721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1626461364", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03edc10a-5365-4b5f-86af-57e7b3dff290"}], "security_groups": [{"name": "tempest-securitygroup--1111954681"}], "key_name": "tempest-keypair-256273803", "user_data": "}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:12.327596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:12.328253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:12.334423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:12.334865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:12.335624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:12.336049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:12.486072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:12.494375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1172a30c-51e4-494d-ad07-a5aec09c8f87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.172218 Mar 08 13:21:12.495413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 140/278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:12.676441 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:12.677340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:12.684146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:12.684605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:12.685436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:12.686616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:12.834053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:12.842280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:12.843672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:12.846165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-18a16bb3-4dea-445c-b0b8-479cbec99a27 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.172824 Mar 08 13:21:12.847550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 141/279] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:12.871344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] validate_networks() for [('03edc10a-5365-4b5f-86af-57e7b3dff290', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:21:13.252462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:21:13.252951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:21:13.253420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:21:13.253845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:21:13.254236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:21:13.263375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:13.263987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:13.265328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:13.265793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:13.282183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:21:13.286114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:21:13.296837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:21:13.299082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:21:13.436623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a95fb48f-ffdf-4685-9aee-782514f9efb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.413785 Mar 08 13:21:13.437371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 139/280] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:21:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:21:13.447222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-48a8ebaa-e26b-4bfb-9d3e-0db7b49e921c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:13.447822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-48a8ebaa-e26b-4bfb-9d3e-0db7b49e921c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:13.506203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-48a8ebaa-e26b-4bfb-9d3e-0db7b49e921c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:13.511717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:13.512322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:13.512484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-48a8ebaa-e26b-4bfb-9d3e-0db7b49e921c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1241 microversion: 2.1 time: 0.069156 Mar 08 13:21:13.513257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 142/281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:13 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:13.527023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:13.527471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:13.528245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:13.528699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:13.675368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:13.683152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ac567d38-0d5a-4f3f-a0ee-43e302658586 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.175295 Mar 08 13:21:13.683712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 140/282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:13.865977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:13.866581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:13.872350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:13.872845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:13.873680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:13.874038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:14.012443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:14.020895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:14.022399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:14.023538 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf34da6b-24b2-4214-9f5a-b2f570cafb57 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.161491 Mar 08 13:21:14.024095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 143/283] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:14.530162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:14.530713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:14.536979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:14.537422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:14.538173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:14.538601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:14.597109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:14.604131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e98517e8-acbc-4e52-aa1a-3ffb03fb392d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1245 microversion: 2.1 time: 0.078331 Mar 08 13:21:14.604701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 141/284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:14 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:14.700978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:14.701725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:14.707729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:14.708180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:14.708974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:14.709413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:15.042251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:15.042852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:15.049282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:15.049723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:15.050483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:15.050914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:15.086333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:15.094212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e6daa83a-42fe-44b4-91dd-842c74a0eda6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.397165 Mar 08 13:21:15.094790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 144/285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:15.189319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:15.196872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:15.198368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:15.199544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c2b65d3b-0a2d-4dbd-8b6d-26a9c56066ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.161124 Mar 08 13:21:15.200123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 142/286] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:15.621684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:15.622291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:15.628090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:15.628529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:15.629328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:15.629758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:15.685875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:15.693026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dbc2191d-0ed8-4470-9056-32828565d4b2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1245 microversion: 2.1 time: 0.075086 Mar 08 13:21:15.693584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 145/287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:15 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1245 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:16.111282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:16.111887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:16.118836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:16.119281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:16.120322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:16.120783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:16.218493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:16.219262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:16.225101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:16.225551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:16.226333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:16.226864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:16.259472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:16.270549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2ac3bd45-b6a5-4331-b244-1b0dcb02d09d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.163099 Mar 08 13:21:16.273111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 143/288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:16.377361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:16.384682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:16.386196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:16.387387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ceb7d3ec-a9f7-4d43-9f69-3e5be6eb2198 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.173103 Mar 08 13:21:16.387942 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 146/289] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:16.710179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:16.710784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:16.716584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:16.717060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:16.718507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:16.718798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:16.779413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:16.788067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-508af09a-1ce4-43d0-82ef-b1b185a00d1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1293 microversion: 2.1 time: 0.081687 Mar 08 13:21:16.788738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 144/290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:16 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:17.289652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:17.290258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:17.296052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:17.296488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:17.297282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:17.297711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:17.407610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:17.408216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:17.414031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:17.414464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:17.415221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:17.415648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:17.434338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:17.443081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea5b4c81-e292-4893-863e-b60dc65195f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.157154 Mar 08 13:21:17.443663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 147/291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:17.555476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:17.564150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:17.565675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:17.566814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0168589b-c46e-4bbe-a9b1-f8e6872b9341 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.164514 Mar 08 13:21:17.567372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 145/292] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:17.805743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:17.806454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:17.812307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:17.812784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:17.813545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:17.813982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:17.875393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:17.882491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2c1462f2-594e-4406-a029-a56b923abff6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1293 microversion: 2.1 time: 0.080657 Mar 08 13:21:17.883037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 148/293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:17 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:18.460494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:18.461142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:18.468199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:18.468889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:18.469666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:18.470107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:18.585421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:18.586029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:18.591685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:18.592129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:18.593579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:18.594138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:18.600532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:18.609365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eeddd2f7-110a-439f-89b4-ad6d4f8e626c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.151865 Mar 08 13:21:18.609943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 146/294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:18.730152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:18.739210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:18.740725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:18.741895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-44c9c26f-40b1-4c03-a6a3-0b3b84ec8fb8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.160314 Mar 08 13:21:18.742440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 149/295] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:18.899360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:18.899963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:18.906326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:18.906779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:18.907617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:18.908044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:18.970636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:18.979242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c6a8611a-2083-4d5c-b265-051832a550fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1293 microversion: 2.1 time: 0.083734 Mar 08 13:21:18.979831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 147/296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:18 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:19.626094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:19.626696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:19.632675 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:19.633127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:19.633884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:19.634313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:19.761188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:19.761806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:19.771374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:19.773848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:19.773848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:19.773848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:19.773848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:19.779438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a8edcc0-7a7e-4cc0-93d7-fded678cde91 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.157174 Mar 08 13:21:19.780080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 150/297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:19.919277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:19.929052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:19.930703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:19.931891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-160e6124-3ada-4457-a400-558210d7da52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1720 microversion: 2.20 time: 0.175203 Mar 08 13:21:19.932491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 148/298] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:20.000376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:20.001395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:20.007795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:20.008511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:20.009372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:20.009903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:20.081320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:20.089319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8369964a-f580-4f2d-a6d6-43b116b10c16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1301 microversion: 2.1 time: 0.095087 Mar 08 13:21:20.093137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 151/299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:19 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:20.803513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:20.806056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:20.826958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:20.827560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:20.832358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:20.832358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:20.951029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:20.953695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:20.963943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:20.964452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:20.965284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:20.965962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:21.009364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:21.017020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-41d221ed-f145-4357-8706-11278fced5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.222012 Mar 08 13:21:21.029189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 149/300] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:21.106328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:21.107051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:21.113505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:21.114032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:21.114895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:21.115398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:21.251845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:21.259598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b584dd61-6bfe-42af-ad52-84c932b37410 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.157151 Mar 08 13:21:21.260225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 150/301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:21 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:21.294241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:21.302829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:21.304338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:21.305755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b710e3a6-adc6-4f66-88cf-3709c035872d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1741 microversion: 2.20 time: 0.358996 Mar 08 13:21:21.306086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 152/302] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1741 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:21.813479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-569c2f19-99c8-4734-bac8-9a743fe05df4 req-18c0a885-091d-4798-976a-1f70ae102cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f74deff-dd51-47b8-9015-5120e8f0106e", "tag": "caf93497-f9e2-4e24-8a43-bc0cbf8ce269"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:21.829802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-569c2f19-99c8-4734-bac8-9a743fe05df4 req-18c0a885-091d-4798-976a-1f70ae102cb8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:21.829802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-569c2f19-99c8-4734-bac8-9a743fe05df4 req-18c0a885-091d-4798-976a-1f70ae102cb8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:21.843460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-569c2f19-99c8-4734-bac8-9a743fe05df4 req-18c0a885-091d-4798-976a-1f70ae102cb8 service nova] Creating event network-changed:caf93497-f9e2-4e24-8a43-bc0cbf8ce269 for instance 8f74deff-dd51-47b8-9015-5120e8f0106e on hv-cinder-83009 Mar 08 13:21:21.849607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-569c2f19-99c8-4734-bac8-9a743fe05df4 req-18c0a885-091d-4798-976a-1f70ae102cb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044964 Mar 08 13:21:21.850823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 151/303] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:21:22.053927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:22.053927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:22.053927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:22.053927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:22.080565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:22.080565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:22.279486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:22.280351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:22.286866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:22.287481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:22.287852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:22.289375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:22.290046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:22.296069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e3032e47-c016-4993-8f4c-913be16a88e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.261919 Mar 08 13:21:22.303354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 153/304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:22.329389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:22.330113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:22.336045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:22.336496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:22.337331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:22.337776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:22.449753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:22.457889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be205643-e3c8-47cf-9baa-11d3fe51b3ba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.184003 Mar 08 13:21:22.458754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 152/305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:22 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:22.585402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:22.595931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:22.595931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:22.596578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bd96b46a-4ec6-44a1-983e-da5f84716df6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1741 microversion: 2.20 time: 0.272001 Mar 08 13:21:22.597177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 154/306] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1741 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:23.313665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:23.314410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:23.321142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:23.321591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:23.322470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:23.322917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:23.473067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:23.476987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:23.478616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:23.481239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f57ba83f-d3a8-4bc2-871b-a6f86bd16015 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.171545 Mar 08 13:21:23.482188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 153/307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:23.495734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:23.496263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:23.497142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:23.497652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:23.614984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:23.616406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:23.622431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:23.623106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:23.623884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:23.624323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:23.640007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:23.647819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-91555b7d-2e12-4143-8610-33af42062a53 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.176457 Mar 08 13:21:23.648386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 155/308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:23 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:23.761881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:23.770012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:23.773101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:23.773101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-431e3826-0c96-405f-acea-c98a8c9fcdac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1741 microversion: 2.20 time: 0.161710 Mar 08 13:21:23.773314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 154/309] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:24.500124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:24.500823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:24.506698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:24.507145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:24.507902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:24.508338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:24.637997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:24.646255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8da5bb64-0a15-4621-8465-854207500988 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.150528 Mar 08 13:21:24.646810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 156/310] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:24.665134 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:24.665738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:24.672677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:24.673192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:24.673947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:24.674378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:24.791285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:24.791883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:24.798302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:24.798709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:24.799468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:24.799894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:24.808332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:24.816262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a6a57ee8-e8d2-4cfe-986f-47f34be6ac87 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.154875 Mar 08 13:21:24.816854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 155/311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:24 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:24.933687 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:24.942042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:24.943773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:24.944953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e9cc9931-b594-4548-8d90-6aff4685ee66 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1741 microversion: 2.20 time: 0.157605 Mar 08 13:21:24.948006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 157/312] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:25.662824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:25.663429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:25.669604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:25.670186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:25.670793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:25.671226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:25.818995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:25.826760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58dd67a8-73ea-451b-8317-5d0fdf499ed3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.167671 Mar 08 13:21:25.832690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:25.833850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:25.837519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 156/313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:25.841733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:25.842178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:25.842939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:25.843998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:25.925444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-0070c9f5-9883-4369-9f2e-dcf45ce2e9e5 req-c6aa2b1f-7ca7-4ff4-8262-d132a48dd029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9aabe1-38e8-4c68-aafc-9a389ce1c127", "name": "network-vif-plugged", "status": "completed", "tag": "5aa555ed-04a0-4927-ab06-464b9c259a70"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:25.934639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-0070c9f5-9883-4369-9f2e-dcf45ce2e9e5 req-c6aa2b1f-7ca7-4ff4-8262-d132a48dd029 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:25.935148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-0070c9f5-9883-4369-9f2e-dcf45ce2e9e5 req-c6aa2b1f-7ca7-4ff4-8262-d132a48dd029 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:25.947068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-0070c9f5-9883-4369-9f2e-dcf45ce2e9e5 req-c6aa2b1f-7ca7-4ff4-8262-d132a48dd029 service nova] Creating event network-vif-plugged:5aa555ed-04a0-4927-ab06-464b9c259a70 for instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 on hv-cinder-83009 Mar 08 13:21:25.952255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-0070c9f5-9883-4369-9f2e-dcf45ce2e9e5 req-c6aa2b1f-7ca7-4ff4-8262-d132a48dd029 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034003 Mar 08 13:21:25.956447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 157/314] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:21:25.966867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:25.968295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:25.980605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:25.981080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:25.981851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:25.982284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:26.028531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:26.036574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-67461e2f-e608-4950-8851-8566623e152b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.207589 Mar 08 13:21:26.037635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 158/315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:25 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:26.174526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:26.182361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:26.183847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:26.185211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7f3f81ec-8955-42a8-9f5b-dcef751c3595 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1741 microversion: 2.20 time: 0.223150 Mar 08 13:21:26.185760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 158/316] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:26.844809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:26.848985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:26.851407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:26.851850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:26.852692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:26.853122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:26.987856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:26.996057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e3e456c1-067e-432b-9da1-37952bb8b3eb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.156024 Mar 08 13:21:26.996621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 159/317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:27.053483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:27.054094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:27.060455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:27.062666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:27.062666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:27.062666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:27.208770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:27.209299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:27.215504 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:27.224602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:27.224602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:27.224602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:27.244870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:27.253569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-899a9477-4ef2-4aeb-8e8a-874ea08385de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.203809 Mar 08 13:21:27.254709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 159/318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:27 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:27.354831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:27.362894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:27.364383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:27.365559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3946563b-86a7-43da-b0ff-02222d14d451 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1741 microversion: 2.20 time: 0.162550 Mar 08 13:21:27.366187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 160/319] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:28.012327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:28.013216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:28.019066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:28.019463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:28.020228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:28.020689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:28.157689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:28.165502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6307c148-32f9-4290-9389-2c6da020d9e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.157180 Mar 08 13:21:28.166075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 160/320] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:28.272183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:28.272183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:28.277964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:28.278411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:28.279175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:28.279721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:28.385343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:28.387650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:28.398153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:28.398922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:28.402807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:28.403754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:28.438734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:28.447111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dd2f10fe-bd52-4946-ad25-672340f48cff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.180262 Mar 08 13:21:28.447673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 161/321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:28 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:28.558631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:28.566592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:28.568094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:28.569283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d12e257b-1185-4227-af0e-23d8f0088ccd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1741 microversion: 2.20 time: 0.189188 Mar 08 13:21:28.569847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 161/322] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:29.183086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:29.183689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:29.190404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:29.192992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:29.192992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:29.192992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:29.358123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:29.366858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-154e2c87-4173-4c93-a6be-063a08176a1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.187857 Mar 08 13:21:29.367429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 162/323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:29.464967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:29.467654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:29.474781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:29.475225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:29.476272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:29.476582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:29.588032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:29.588706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:29.604090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:29.604537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:29.605336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:29.605774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:29.622288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:29.633565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-765e38fc-c6de-40e4-85c7-d7be6c0c0d8d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.172402 Mar 08 13:21:29.646459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 162/324] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:29 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:29.809894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:29.835131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:29.837897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:29.840273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-96a646f2-509e-47c5-8aa9-6824778600a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.255352 Mar 08 13:21:29.852635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 163/325] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:29.923716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-4dc9a5ab-c4e2-4722-86dc-187404f9503b req-4bf2aba6-bdbe-4ce0-af2a-b5195c755909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f74deff-dd51-47b8-9015-5120e8f0106e", "name": "network-vif-plugged", "status": "completed", "tag": "caf93497-f9e2-4e24-8a43-bc0cbf8ce269"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:29.931785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-4dc9a5ab-c4e2-4722-86dc-187404f9503b req-4bf2aba6-bdbe-4ce0-af2a-b5195c755909 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:29.932430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-4dc9a5ab-c4e2-4722-86dc-187404f9503b req-4bf2aba6-bdbe-4ce0-af2a-b5195c755909 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:29.947282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-4dc9a5ab-c4e2-4722-86dc-187404f9503b req-4bf2aba6-bdbe-4ce0-af2a-b5195c755909 service nova] Creating event network-vif-plugged:caf93497-f9e2-4e24-8a43-bc0cbf8ce269 for instance 8f74deff-dd51-47b8-9015-5120e8f0106e on hv-cinder-83009 Mar 08 13:21:29.952688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-4dc9a5ab-c4e2-4722-86dc-187404f9503b req-4bf2aba6-bdbe-4ce0-af2a-b5195c755909 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033118 Mar 08 13:21:29.955091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 163/326] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:30.387623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:30.399119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:30.399119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:30.399119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:30.399119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:30.399669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:30.613163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:30.623273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7e10f238-c340-4aaf-b7c6-9a5cc6f30989 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.239369 Mar 08 13:21:30.623966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 164/327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:30.653128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:30.654138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:30.661819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:30.662274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:30.665792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:30.665792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:30.834788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:30.842729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ba249bd6-8847-4522-b547-2ca60f5e469e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1367 microversion: 2.1 time: 0.195030 Mar 08 13:21:30.843755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 164/328] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:30 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:30.859601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:30.860234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:30.870861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:30.878521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:30.878521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:30.878521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:31.106849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:31.119094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:31.121530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:31.124133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5c750c7b-0fa2-4d5a-bc38-febcb6094ec7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.268592 Mar 08 13:21:31.125003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 165/329] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:31.622668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1550468070", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1996988874", "security_groups": [{"name": "tempest-secgroup-smoke-464006620"}], "block_device_mapping_v2": [{"uuid": "cfbdc071-9862-441b-9a54-51c7bd5b28b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "de17dbef-96af-40ba-ae3d-3833195e928c"}]}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:31.642108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:31.643416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:31.651539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:31.654206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:31.655231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:31.658954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:31.865564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] validate_networks() for [('de17dbef-96af-40ba-ae3d-3833195e928c', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:21:31.914079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:31.923131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-389c0646-14f5-40df-83d3-af330dad08f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.284958 Mar 08 13:21:31.925140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 166/330] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:31.934707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d402cce9-b5aa-4e4e-a36b-c4fa317a4611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8d953f8-136b-4374-b330-37498bda563e", "device": "/dev/sdb"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:31.939280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d402cce9-b5aa-4e4e-a36b-c4fa317a4611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:31.943491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d402cce9-b5aa-4e4e-a36b-c4fa317a4611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:31.944415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d402cce9-b5aa-4e4e-a36b-c4fa317a4611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:31.945442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d402cce9-b5aa-4e4e-a36b-c4fa317a4611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:31.946086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d402cce9-b5aa-4e4e-a36b-c4fa317a4611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:32.460069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:21:32.460310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:21:32.460757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:21:32.461358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:21:32.461775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:21:32.472229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:32.472963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:32.473772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:32.474209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:32.495672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Getting quotas for project 52fda171a20f4fe3b366624e9c26e12a. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:21:32.500207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Getting quotas for user f98c597d9e1a45e7bd8267b730a0b84b and project 52fda171a20f4fe3b366624e9c26e12a. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:21:32.578238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:21:32.581092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfbdc071-9862-441b-9a54-51c7bd5b28b2',volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:21:33.410048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d402cce9-b5aa-4e4e-a36b-c4fa317a4611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "POST /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.483408 Mar 08 13:21:33.428642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 167/331] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:21:31 2022] POST /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments => generated 194 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:33.436104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:33.441768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:33.450996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.451681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.452948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.453569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.534859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0f72e85-4d63-4301-9ce2-583eb3514309 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.916200 Mar 08 13:21:33.539385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 165/332] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:21:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:21:33.550022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:33.550989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:33.567911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.569489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.570505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.571134 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.738124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:33.745735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7fd2db9d-52d0-4c2b-9698-434f7105a8c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1558 microversion: 2.1 time: 0.315568 Mar 08 13:21:33.746298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 168/333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:33 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1558 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:33.752938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:33.753929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:33.760470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.761162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.762198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.762807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.799707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:33.821210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:33.822911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:33.824302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-13c6b685-3fa5-4fe7-b5b6-fbbc2e46f588 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.283591 Mar 08 13:21:33.825396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 166/334] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:33.830399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c72e21f5-008e-44d1-8054-3b1b6d4f9b2e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:33.831207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c72e21f5-008e-44d1-8054-3b1b6d4f9b2e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:33.886776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c72e21f5-008e-44d1-8054-3b1b6d4f9b2e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:33.895167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c72e21f5-008e-44d1-8054-3b1b6d4f9b2e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1095 microversion: 2.1 time: 0.068491 Mar 08 13:21:33.896911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 167/335] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:33 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:33.911953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-00075154-7751-4a1f-a4c5-22b0a249e325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:33.912844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-00075154-7751-4a1f-a4c5-22b0a249e325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:33.920086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00075154-7751-4a1f-a4c5-22b0a249e325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.920773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00075154-7751-4a1f-a4c5-22b0a249e325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.921721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00075154-7751-4a1f-a4c5-22b0a249e325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:33.922441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00075154-7751-4a1f-a4c5-22b0a249e325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:33.945097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:33.957781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-80d8d258-1446-4e11-adf3-400423155cef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.208643 Mar 08 13:21:33.958443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 169/336] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:34.034635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-00075154-7751-4a1f-a4c5-22b0a249e325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136159 Mar 08 13:21:34.035220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 168/337] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Mar 8 13:21:33 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:34.843183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:34.845686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:34.850953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:34.851401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:34.853629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:34.854304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:34.914461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:34.917902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:34.948022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:34.949106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:34.954773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:34.954773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:35.054291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:35.056106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:35.063888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:35.066345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-93fedb24-869a-40a8-900e-1906760bd790 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1145 microversion: 2.1 time: 0.156105 Mar 08 13:21:35.066594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:35.068029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bb595875-1510-461e-8588-b9686d6717c7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.228867 Mar 08 13:21:35.078371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 169/338] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:34 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1145 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:35.080284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 170/339] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:34 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:35.090639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:35.091261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:35.101855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:35.102717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:35.103741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:35.104245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:35.388318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:35.403803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9bf4017b-bfa6-43f3-8817-c7ead8f7f265 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.321216 Mar 08 13:21:35.407089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 170/340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:35.716050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-e05bda07-7835-4a96-b43d-2c5a487368d5 req-ae6ea4f4-9c25-444e-8487-6611929e0dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f74deff-dd51-47b8-9015-5120e8f0106e", "tag": "caf93497-f9e2-4e24-8a43-bc0cbf8ce269"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:35.724530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-e05bda07-7835-4a96-b43d-2c5a487368d5 req-ae6ea4f4-9c25-444e-8487-6611929e0dd2 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:35.725249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-e05bda07-7835-4a96-b43d-2c5a487368d5 req-ae6ea4f4-9c25-444e-8487-6611929e0dd2 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:35.738638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-e05bda07-7835-4a96-b43d-2c5a487368d5 req-ae6ea4f4-9c25-444e-8487-6611929e0dd2 service nova] Creating event network-changed:caf93497-f9e2-4e24-8a43-bc0cbf8ce269 for instance 8f74deff-dd51-47b8-9015-5120e8f0106e on hv-cinder-83009 Mar 08 13:21:35.745483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-e05bda07-7835-4a96-b43d-2c5a487368d5 req-ae6ea4f4-9c25-444e-8487-6611929e0dd2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033272 Mar 08 13:21:35.746284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 171/341] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:36.097328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:36.099074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:36.100588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:36.101605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:36.119021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:36.125079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:36.125229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:36.125357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:36.126402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:36.127072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:36.131207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:36.132733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:36.251237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:36.259624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-319b75ff-8954-4065-a904-e61695ca61fc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1193 microversion: 2.1 time: 0.175938 Mar 08 13:21:36.261150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 171/342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:36 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1193 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:36.422531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:36.424109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:36.441505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:36.446170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:36.446170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:36.446170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:36.591567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:36.603181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:36.622666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:36.626069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aed510c7-ab62-407d-a4ea-f4f7cd8bebe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.536608 Mar 08 13:21:36.626069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 172/343] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:36.827425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:36.865228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-57bc6921-a3bf-4022-883a-ebb701a5e96e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.436745 Mar 08 13:21:36.865228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 172/344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:37.277453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:37.278075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:37.285392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:37.285839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:37.286609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:37.287047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:37.358734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:37.366618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dc35cf64-ed40-4d3f-bb8b-000f2ad7bf0d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1201 microversion: 2.1 time: 0.093151 Mar 08 13:21:37.367482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 173/345] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:37 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:37.646120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:37.646736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:37.652854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:37.653734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:37.658720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:37.658720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:37.879079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:37.879699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:37.890554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:37.895906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:37.897037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:37.899811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:38.039209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:38.047290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:38.052929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:38.057132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d7e9145b-7fdb-4331-acf1-71f0a76c4b4e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.416090 Mar 08 13:21:38.069010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 173/346] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:37 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:38.101498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:38.111904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d3e78ed0-9f9a-4083-b7bd-f2d12a1c8ead tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.238651 Mar 08 13:21:38.121460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 174/347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:38.383299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:38.386449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:38.396532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:38.397499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:38.398458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:38.399051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:38.476927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:38.490328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-569faae6-2d42-46b4-9f8c-d42670798203 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1211 microversion: 2.1 time: 0.108773 Mar 08 13:21:38.492635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 174/348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:38 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:39.075809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:39.076461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:39.086755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.087449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.088431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.088938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.130127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:39.131310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:39.146178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.147195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.148194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.159885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.306135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:39.330932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:39.333015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:39.334412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e837f211-6df4-4f10-b3ca-7b7cf047dd03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.262683 Mar 08 13:21:39.340069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 175/349] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:39.462668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:39.473973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-db721882-1b7d-4093-95b7-fa9ce5b85aaa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1548 microversion: 2.1 time: 0.348175 Mar 08 13:21:39.477464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 175/350] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1548 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:39.511853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:39.518722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:39.523476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:39.527348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:39.541445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.546237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.546237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.551491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.552755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.553463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.555074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.558474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.811502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] HTTP exception thrown: Cannot 'detach_volume' instance dd6bc389-6db6-4800-b030-7ee0a855e6de while it is in vm_state rescued Mar 08 13:21:39.812612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Returning 409 to user: Cannot 'detach_volume' instance dd6bc389-6db6-4800-b030-7ee0a855e6de while it is in vm_state rescued {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:21:39.815048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bab244b6-9ab9-407c-ab38-e6c104d471db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments/61eea3fb-a4e3-4b07-83de-10ec7479bea1" status: 409 len: 152 microversion: 2.1 time: 0.324358 Mar 08 13:21:39.816469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 176/351] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:21:39 2022] DELETE /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments/61eea3fb-a4e3-4b07-83de-10ec7479bea1 => generated 152 bytes in 328 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 08 13:21:39.830380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f8ae1776-4b4d-42ff-b46b-d29d1822f7f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:39.831241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f8ae1776-4b4d-42ff-b46b-d29d1822f7f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:39.839961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8ae1776-4b4d-42ff-b46b-d29d1822f7f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.841038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8ae1776-4b4d-42ff-b46b-d29d1822f7f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:39.842388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8ae1776-4b4d-42ff-b46b-d29d1822f7f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:39.843155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8ae1776-4b4d-42ff-b46b-d29d1822f7f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:40.062799 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:40.070032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f8ae1776-4b4d-42ff-b46b-d29d1822f7f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action" status: 202 len: 0 microversion: 2.1 time: 0.246232 Mar 08 13:21:40.074465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-21a1a32d-a023-4adf-9aa1-e0ca86baaa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1278 microversion: 2.1 time: 0.568339 Mar 08 13:21:40.074890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 177/352] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:21:39 2022] POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:21:40.096128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 176/353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:39 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1278 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:40.103358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:40.107673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:40.120784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:40.121630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:40.122666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:40.123442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:40.124427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-37bb99b8-fc60-494d-b7fd-b34134df1c0d req-7afdd832-e411-47a0-a6af-7a8ebc3bfdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4990fb-f02f-4297-a1c5-b1970d04c24c", "tag": "7958797c-844d-4a07-8ade-398ea8375499"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:40.158431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-37bb99b8-fc60-494d-b7fd-b34134df1c0d req-7afdd832-e411-47a0-a6af-7a8ebc3bfdb8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:40.158885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-37bb99b8-fc60-494d-b7fd-b34134df1c0d req-7afdd832-e411-47a0-a6af-7a8ebc3bfdb8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:40.195559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-37bb99b8-fc60-494d-b7fd-b34134df1c0d req-7afdd832-e411-47a0-a6af-7a8ebc3bfdb8 service nova] Creating event network-changed:7958797c-844d-4a07-8ade-398ea8375499 for instance 0d4990fb-f02f-4297-a1c5-b1970d04c24c on hv-cinder-83009 Mar 08 13:21:40.212794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-37bb99b8-fc60-494d-b7fd-b34134df1c0d req-7afdd832-e411-47a0-a6af-7a8ebc3bfdb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136469 Mar 08 13:21:40.213990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 178/354] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:40.359044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:40.359952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:40.368556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:40.369348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:40.370388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:40.371046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:40.506056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:40.526844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-62fd181f-6e6a-4171-8956-4d3a596f31d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1556 microversion: 2.1 time: 0.417746 Mar 08 13:21:40.527815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 177/355] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1556 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:40.722692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:40.736173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:40.739753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:40.742745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-43134f35-b7b4-4b38-9dd5-9c31ce58e2c3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.389641 Mar 08 13:21:40.744244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 179/356] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:41.102740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:41.103777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:41.115611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:41.117139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:41.120207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:41.121185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:41.380454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:41.397415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-464a118e-1a89-48f3-b750-f6191e77562d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1278 microversion: 2.1 time: 0.298490 Mar 08 13:21:41.398542 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 178/357] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1278 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:41.616910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:41.616910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:41.616910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:41.616910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:41.618993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:41.618993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:41.762076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:41.763352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:41.788392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:41.788989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:41.790003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:41.790613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:41.864330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:41.900713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-095bc3a2-3404-4ac2-8bc0-18cc3c2f9bc8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1556 microversion: 2.1 time: 0.344215 Mar 08 13:21:41.909840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 180/358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1556 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:41.977440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1535633314", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:42.034268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.network.neutron [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] validate_networks() for None {{(pid=117282) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:21:42.044972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:42.053597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:42.055112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:42.056273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b43eb2e5-1701-4be4-857a-97dea63b485e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.298030 Mar 08 13:21:42.057213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 179/359] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:42.416106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:42.417246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:42.424853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:42.426236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:42.428624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:42.429206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:42.649533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Flavor limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:21:42.650125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Image limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:21:42.650711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Flavor pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:21:42.651229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Image pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:21:42.653478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:21:42.668005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:42.668872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:42.669991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:42.671381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:42.697642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Getting quotas for project 6d3ba160ad2b455fb1c10adf23c23040. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:21:42.702666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Getting quotas for user b524bd502e2e4e38937db3c691e21a2c and project 6d3ba160ad2b455fb1c10adf23c23040. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:21:42.718286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Going to run 1 instances... {{(pid=117282) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:21:42.723594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:21:42.764332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:42.773599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-20231649-7556-491d-b1da-4554b7950423 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1278 microversion: 2.1 time: 0.362167 Mar 08 13:21:42.784955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 180/360] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1278 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:42.904309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-05737fcd-0cfa-46e7-8361-4950a12e1982 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930746 Mar 08 13:21:42.917151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ffc0514c-86eb-490c-8e90-656f959f1c11 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:42.918361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ffc0514c-86eb-490c-8e90-656f959f1c11 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:42.924502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 181/361] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:21:42.934319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:42.935705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:42.949973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:42.952890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:42.953791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:42.957671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:43.070794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ffc0514c-86eb-490c-8e90-656f959f1c11 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:43.078638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ffc0514c-86eb-490c-8e90-656f959f1c11 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1215 microversion: 2.1 time: 0.165937 Mar 08 13:21:43.090535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 181/362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:42 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:43.099936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:43.102213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:43.117223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:43.122383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:43.123392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:43.123836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:43.137821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:43.149498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f7f53c9f-3372-4108-97ab-30a31455ae8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1556 microversion: 2.1 time: 0.223589 Mar 08 13:21:43.150663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 182/363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:43.301026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:43.308748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:43.310239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:43.311404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b7fd3875-fbd9-44a1-9b7e-74667eda85f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.215771 Mar 08 13:21:43.311959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 182/364] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:43.791522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:43.792140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:43.798304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:43.799349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:43.800259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:43.800718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:43.943336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:43.960269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9e8842a4-c615-423c-9cef-6f7bc1e06136 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1278 microversion: 2.1 time: 0.172466 Mar 08 13:21:43.960974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 183/365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:43 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:44.099407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-96170908-b789-4064-8c97-076d5fd12603 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:44.100137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-96170908-b789-4064-8c97-076d5fd12603 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:44.162838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-96170908-b789-4064-8c97-076d5fd12603 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:44.170207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:44.171811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-96170908-b789-4064-8c97-076d5fd12603 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1215 microversion: 2.1 time: 0.077714 Mar 08 13:21:44.172540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:44.174407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 183/366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:44 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:44.190147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.190702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:44.191483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.191968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:44.330794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:44.331489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:44.345587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.347654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:44.349238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.355499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:44.378384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:44.388422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-48a0cfef-6916-437f-9578-00d489b1d80c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1562 microversion: 2.1 time: 0.224220 Mar 08 13:21:44.389208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 184/367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:44.474179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:44.474674 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:44.482673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.483125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:44.483901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.487153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:44.587355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:44.595429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:44.597188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:44.598333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eef6299b-74d1-4728-b0cc-8c4fc57149fc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1736 microversion: 2.20 time: 0.272636 Mar 08 13:21:44.598908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 184/368] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:44.849203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lazy-loading 'services' on Instance uuid dd6bc389-6db6-4800-b030-7ee0a855e6de {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:21:44.979456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:44.981011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:44.989350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.990031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:44.990974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:44.991602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:45.240283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:45.248547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cad4fbfc-e25b-4daa-a142-8e69ee63cad8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1278 microversion: 2.1 time: 0.274520 Mar 08 13:21:45.257668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 185/369] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:44 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:45.261482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:45.262105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:45.268332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:45.269398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:45.269758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:45.270377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:45.298031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a8ca4faf-8aff-4d9d-a8e9-6f64a5bdd572 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments/61eea3fb-a4e3-4b07-83de-10ec7479bea1" status: 202 len: 0 microversion: 2.1 time: 0.828855 Mar 08 13:21:45.299242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 185/370] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:21:44 2022] DELETE /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments/61eea3fb-a4e3-4b07-83de-10ec7479bea1 => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:21:45.318171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f529bde3-06e6-4145-9ed4-762f68d2e339 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:45.321772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f529bde3-06e6-4145-9ed4-762f68d2e339 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:45.327234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f529bde3-06e6-4145-9ed4-762f68d2e339 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:45.327900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f529bde3-06e6-4145-9ed4-762f68d2e339 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:45.328852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f529bde3-06e6-4145-9ed4-762f68d2e339 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:45.329413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f529bde3-06e6-4145-9ed4-762f68d2e339 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:45.373623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:45.378736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f529bde3-06e6-4145-9ed4-762f68d2e339 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074670 Mar 08 13:21:45.380146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 186/371] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:45.383847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e2e620f2-5c5c-46b3-a109-cbcf65e827e4 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1211 microversion: 2.1 time: 0.130808 Mar 08 13:21:45.386139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 186/372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:45 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:45.617280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:45.617938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:45.623837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:45.624282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:45.625069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:45.625500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:45.760910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:45.769543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:45.771041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:45.772193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-93aa7b57-de9c-4ddb-86e3-cdcb5d159863 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1718 microversion: 2.20 time: 0.158735 Mar 08 13:21:45.780420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 187/373] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:46.268551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:46.269232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:46.275525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.275974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:46.276776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.277218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:46.392223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c5a0f741-6f52-43e8-bb7e-e0f5228a10a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:46.396399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c5a0f741-6f52-43e8-bb7e-e0f5228a10a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:46.402300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5a0f741-6f52-43e8-bb7e-e0f5228a10a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.402840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5a0f741-6f52-43e8-bb7e-e0f5228a10a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:46.403826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5a0f741-6f52-43e8-bb7e-e0f5228a10a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.404260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5a0f741-6f52-43e8-bb7e-e0f5228a10a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:46.448544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c5a0f741-6f52-43e8-bb7e-e0f5228a10a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060915 Mar 08 13:21:46.449151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 188/374] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:21:46.453914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:46.454515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:46.461414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.461861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:46.462802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.463241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:46.499291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:46.508076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-572fc903-f063-4d37-9dbf-9f97feedf55c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.243980 Mar 08 13:21:46.517591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 187/375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:46.531386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:46.541491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b16ba793-f5d7-44ee-a1cc-524712ff8045 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1273 microversion: 2.1 time: 0.091167 Mar 08 13:21:46.543188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 189/376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:46 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:46.793511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:46.795309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:46.800557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.801024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:46.801806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:46.802238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.062479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:47.070714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:47.072203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:47.073382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-585870be-ea9b-4b5f-8d06-7b5136e9a8e7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1718 microversion: 2.20 time: 0.283879 Mar 08 13:21:47.073923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 188/377] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1718 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:47.480085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-00d43885-a8f9-4652-9f32-7561b71800dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:47.480085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-00d43885-a8f9-4652-9f32-7561b71800dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:47.480085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d43885-a8f9-4652-9f32-7561b71800dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:47.480085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d43885-a8f9-4652-9f32-7561b71800dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.481308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d43885-a8f9-4652-9f32-7561b71800dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:47.481308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d43885-a8f9-4652-9f32-7561b71800dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.512475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-00d43885-a8f9-4652-9f32-7561b71800dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056570 Mar 08 13:21:47.514791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 190/378] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:47.524939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:47.525632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:47.531747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:47.532267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.533605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:47.534046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.559667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:47.573051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:47.580809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:47.581392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.585357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:47.585357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.750715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:47.764023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2e217a23-251f-497b-a37a-0e87e20fcbb9 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.208158 Mar 08 13:21:47.777883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 191/379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:47 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:47.821227 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:47.832755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f2dfe3e5-c47c-40ac-8b01-c4145973f552 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.310420 Mar 08 13:21:47.834911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 189/380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:47.876018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-dceb6407-c735-4d9d-b6a3-233770442d97 req-26525d85-aeea-4317-aedf-bc5561dd01fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9aabe1-38e8-4c68-aafc-9a389ce1c127", "name": "network-vif-unplugged", "status": "completed", "tag": "5aa555ed-04a0-4927-ab06-464b9c259a70"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:47.884219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-dceb6407-c735-4d9d-b6a3-233770442d97 req-26525d85-aeea-4317-aedf-bc5561dd01fd service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:47.884688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-dceb6407-c735-4d9d-b6a3-233770442d97 req-26525d85-aeea-4317-aedf-bc5561dd01fd service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:47.896266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-dceb6407-c735-4d9d-b6a3-233770442d97 req-26525d85-aeea-4317-aedf-bc5561dd01fd service nova] Creating event network-vif-unplugged:5aa555ed-04a0-4927-ab06-464b9c259a70 for instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 on hv-cinder-83009 Mar 08 13:21:47.901177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-dceb6407-c735-4d9d-b6a3-233770442d97 req-26525d85-aeea-4317-aedf-bc5561dd01fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029397 Mar 08 13:21:47.901748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 192/381] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:48.091350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:48.091971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:48.108587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.109920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.110964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.111905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.315977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:48.324237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:48.325794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:48.326946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f956662f-fd2e-43fa-b241-7ef8aaaf2dd3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1721 microversion: 2.20 time: 0.239614 Mar 08 13:21:48.327497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 190/382] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:48 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:48.345474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9d00086f-9d6f-4d16-a298-9437209d8815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de97e165-7a16-43c7-84fb-bd3abbacc68d"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:48.348137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9d00086f-9d6f-4d16-a298-9437209d8815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:48.355283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d00086f-9d6f-4d16-a298-9437209d8815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.355733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d00086f-9d6f-4d16-a298-9437209d8815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.356509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d00086f-9d6f-4d16-a298-9437209d8815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.356973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d00086f-9d6f-4d16-a298-9437209d8815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.399970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-a3c036fd-3767-4041-87a7-bfeb8f9c1819 req-51a1a79a-331b-484a-b85b-02d2d97de35c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9db54d4-0810-44c4-aac5-298540bc5521", "tag": "599efce6-627c-4cdc-8377-c0e35b0bc4d5"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:48.410003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-a3c036fd-3767-4041-87a7-bfeb8f9c1819 req-51a1a79a-331b-484a-b85b-02d2d97de35c service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.410626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-a3c036fd-3767-4041-87a7-bfeb8f9c1819 req-51a1a79a-331b-484a-b85b-02d2d97de35c service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.424723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-a3c036fd-3767-4041-87a7-bfeb8f9c1819 req-51a1a79a-331b-484a-b85b-02d2d97de35c service nova] Creating event network-changed:599efce6-627c-4cdc-8377-c0e35b0bc4d5 for instance a9db54d4-0810-44c4-aac5-298540bc5521 on hv-cinder-83009 Mar 08 13:21:48.430903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-a3c036fd-3767-4041-87a7-bfeb8f9c1819 req-51a1a79a-331b-484a-b85b-02d2d97de35c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034654 Mar 08 13:21:48.431808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 191/383] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:48.527307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f9605fd-1626-403a-85ce-8593fe25bad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:48.527307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f9605fd-1626-403a-85ce-8593fe25bad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:48.532491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f9605fd-1626-403a-85ce-8593fe25bad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.532961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f9605fd-1626-403a-85ce-8593fe25bad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.533768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f9605fd-1626-403a-85ce-8593fe25bad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.534352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f9605fd-1626-403a-85ce-8593fe25bad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.572047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f9605fd-1626-403a-85ce-8593fe25bad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051162 Mar 08 13:21:48.576027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 192/384] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:48.782602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:48.783693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:48.790717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.791171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:48.792647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:48.793044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.002537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:49.009911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0d6abe04-1170-4a22-be58-336c64077e0f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.231698 Mar 08 13:21:49.010572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 193/385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:48 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:49.015046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:49.015974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:49.023517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.024047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.024937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.025440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.466919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:49.479157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1b1bd535-1f78-4b4f-aba2-734abc3c183a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.467485 Mar 08 13:21:49.479866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 194/386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:49 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:49.495393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9d00086f-9d6f-4d16-a298-9437209d8815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.154401 Mar 08 13:21:49.496305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 193/387] 10.222.0.52 () {62 vars in 1363 bytes} [Tue Mar 8 13:21:48 2022] POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 188 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:21:49.588615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f065a8d-11ee-4fa1-953d-d30810d73ee4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:49.590427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f065a8d-11ee-4fa1-953d-d30810d73ee4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:49.597427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f065a8d-11ee-4fa1-953d-d30810d73ee4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.598138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f065a8d-11ee-4fa1-953d-d30810d73ee4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.599075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f065a8d-11ee-4fa1-953d-d30810d73ee4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.600127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f065a8d-11ee-4fa1-953d-d30810d73ee4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.618283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-be997074-4a4d-4d3c-ac0d-d63e04fa049a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:49.618842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-be997074-4a4d-4d3c-ac0d-d63e04fa049a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:49.624770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be997074-4a4d-4d3c-ac0d-d63e04fa049a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.625427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be997074-4a4d-4d3c-ac0d-d63e04fa049a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.626359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be997074-4a4d-4d3c-ac0d-d63e04fa049a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.627017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be997074-4a4d-4d3c-ac0d-d63e04fa049a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.631688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f065a8d-11ee-4fa1-953d-d30810d73ee4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052154 Mar 08 13:21:49.632859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 195/388] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:49.837775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-be997074-4a4d-4d3c-ac0d-d63e04fa049a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/action" status: 202 len: 0 microversion: 2.20 time: 0.222884 Mar 08 13:21:49.838608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 194/389] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Mar 8 13:21:49 2022] POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 13:21:49.852724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:49.852724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:49.853791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.854232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.855005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:49.855467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:49.990316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:49.998935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:50.000787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:50.001659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b4f81686-efb1-4cbc-81f7-fa24470e4354 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1747 microversion: 2.20 time: 0.159303 Mar 08 13:21:50.002376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 196/390] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:50.027339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:50.029808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:50.034411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:50.034886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:50.035642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:50.036080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:50.170388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:50.178266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-71494032-fc37-41e3-945d-dff0c99b6b92 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.154867 Mar 08 13:21:50.178833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 195/391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:50 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:50.495951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:50.496566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:50.503401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:50.503924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:50.504905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:50.505390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:50.651449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a0f6af1a-1d20-488e-bbc7-80dfaecf3856 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:50.652488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a0f6af1a-1d20-488e-bbc7-80dfaecf3856 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:50.664552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a0f6af1a-1d20-488e-bbc7-80dfaecf3856 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:50.664832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:50.665276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a0f6af1a-1d20-488e-bbc7-80dfaecf3856 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:50.666450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a0f6af1a-1d20-488e-bbc7-80dfaecf3856 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:50.666967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a0f6af1a-1d20-488e-bbc7-80dfaecf3856 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:50.672511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-852fd673-61f3-4345-aaa8-0be33f91cfa6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.180379 Mar 08 13:21:50.673268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 197/392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:50.698365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a0f6af1a-1d20-488e-bbc7-80dfaecf3856 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058896 Mar 08 13:21:50.699117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 196/393] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:21:51.019356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:51.019958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:51.025667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.026108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.026889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.027319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.160806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:51.169071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:51.170567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:51.171725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-212f5b67-0213-45c5-9329-e7f88ba204ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1747 microversion: 2.20 time: 0.156256 Mar 08 13:21:51.172286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 198/394] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:51.194900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:51.195500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:51.201545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.201987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.202738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.203169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.357747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:51.365380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-00511535-32c6-49ef-bc5c-5df8fbfcb345 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.174261 Mar 08 13:21:51.365932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 197/395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:51 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:51.689622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:51.690831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:51.697096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.697548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.698316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.698753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.709806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a8c1fe3c-64d0-4ef6-98de-8b25e5899911 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:51.710742 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a8c1fe3c-64d0-4ef6-98de-8b25e5899911 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:51.716911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8c1fe3c-64d0-4ef6-98de-8b25e5899911 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.717349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8c1fe3c-64d0-4ef6-98de-8b25e5899911 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.718104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8c1fe3c-64d0-4ef6-98de-8b25e5899911 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:51.718530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8c1fe3c-64d0-4ef6-98de-8b25e5899911 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:51.747823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a8c1fe3c-64d0-4ef6-98de-8b25e5899911 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041833 Mar 08 13:21:51.748384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 198/396] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:21:51.837878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:51.844701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f6badf56-58ea-4e5d-bcde-2e843049cf06 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.158849 Mar 08 13:21:51.845266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 199/397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:52.191670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:52.192301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:52.198276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.198726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:52.199490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.199927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:52.339488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:52.349980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:52.351397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:52.352563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4561497d-0889-4c51-8356-b480e6b6e24f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.165437 Mar 08 13:21:52.353389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 199/398] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:52.381798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:52.382400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:52.388993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.388993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:52.389678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.390113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:52.520987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:52.528337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-20651da9-4e1a-4940-8dcd-83af8e86d719 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.150412 Mar 08 13:21:52.528934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 200/399] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:52 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:52.760882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cd8283e4-86d4-4aa6-b260-2c09ea02a2bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:52.761819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cd8283e4-86d4-4aa6-b260-2c09ea02a2bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:52.768444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd8283e4-86d4-4aa6-b260-2c09ea02a2bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.769084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd8283e4-86d4-4aa6-b260-2c09ea02a2bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:52.769841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd8283e4-86d4-4aa6-b260-2c09ea02a2bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.770272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd8283e4-86d4-4aa6-b260-2c09ea02a2bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:52.798887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cd8283e4-86d4-4aa6-b260-2c09ea02a2bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042993 Mar 08 13:21:52.799618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 200/400] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:52.861272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:52.862147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:52.868385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.868875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:52.869631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:52.870063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:53.010470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:53.018747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1b035543-8031-41b5-80f5-d81595f97554 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.160742 Mar 08 13:21:53.019319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 201/401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:52 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:53.373933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:53.374533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:53.381795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:53.382248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:53.383054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:53.383491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:53.514894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:53.523715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:53.525352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:53.526481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-97ceaf96-ce02-47cf-bb70-69dfd2f701a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156377 Mar 08 13:21:53.527034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 201/402] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:53.545287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:53.545899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:53.551868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:53.552321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:53.553111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:53.553577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:53.681589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:53.688744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a89bbc0c-060b-4ca4-b969-a85feffd3d84 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.147386 Mar 08 13:21:53.689303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 202/403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:53 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:53.810285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-001c4f1c-1378-4d30-a134-e00887a9eb9d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:53.811220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-001c4f1c-1378-4d30-a134-e00887a9eb9d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:53.818206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-001c4f1c-1378-4d30-a134-e00887a9eb9d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:53.818628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-001c4f1c-1378-4d30-a134-e00887a9eb9d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:53.819392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-001c4f1c-1378-4d30-a134-e00887a9eb9d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:53.819821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-001c4f1c-1378-4d30-a134-e00887a9eb9d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:53.849513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-001c4f1c-1378-4d30-a134-e00887a9eb9d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Mar 08 13:21:53.850074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 202/404] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:54.035554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:54.036251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:54.042554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.042995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.043760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.044193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.183076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:54.190366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d96f149-f399-4a08-832d-65c5cc674c54 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.158794 Mar 08 13:21:54.190942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 203/405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:54 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:54.544872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:54.545389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:54.552389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.552859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.553611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.554046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.684780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:54.693263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:54.694766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:54.695906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-231aa530-24e0-4fb8-a3cb-22a6afb9ed9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155095 Mar 08 13:21:54.696463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 203/406] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:54.705473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:54.706722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:54.712507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.713000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.713760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.714194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.846954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:54.854341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-231370d4-643e-48b0-bdc2-4fad433fafd0 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.152650 Mar 08 13:21:54.854908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 204/407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:54 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:54.860868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-be870096-abfd-4991-907e-9062ea22e973 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:54.862572 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-be870096-abfd-4991-907e-9062ea22e973 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:54.869016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be870096-abfd-4991-907e-9062ea22e973 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.869463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be870096-abfd-4991-907e-9062ea22e973 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.870215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be870096-abfd-4991-907e-9062ea22e973 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:54.870714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be870096-abfd-4991-907e-9062ea22e973 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:54.898594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-be870096-abfd-4991-907e-9062ea22e973 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041616 Mar 08 13:21:54.899129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 204/408] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:55.207694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:55.208336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:55.214579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.215024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.215782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.216214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.346056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:55.353472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f6ddc48f-4467-49ee-b1d4-b1dcf7dcfb30 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.150402 Mar 08 13:21:55.354038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 205/409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:55.714932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:55.715543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:55.721781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.722237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.723009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.723439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.856727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:55.866768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:55.868293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:55.869529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-31b3dd82-43dd-4574-aaf7-f20aeb92e26c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158586 Mar 08 13:21:55.870206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 205/410] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:55.879499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:55.882368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:55.886027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.886477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.887254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.887684 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.911089 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6216986d-657a-4408-bc72-be82e51139e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:55.912120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6216986d-657a-4408-bc72-be82e51139e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:55.926530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6216986d-657a-4408-bc72-be82e51139e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.926985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6216986d-657a-4408-bc72-be82e51139e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.927763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6216986d-657a-4408-bc72-be82e51139e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:55.929115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6216986d-657a-4408-bc72-be82e51139e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:55.961946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6216986d-657a-4408-bc72-be82e51139e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055666 Mar 08 13:21:55.962917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 206/411] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:21:55.996060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-66af561d-8e13-4299-931e-0a413c2601e4 req-7a52dc9c-7549-442e-91e8-5813889815c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9db54d4-0810-44c4-aac5-298540bc5521", "name": "network-vif-plugged", "status": "completed", "tag": "599efce6-627c-4cdc-8377-c0e35b0bc4d5"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:21:56.005046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-66af561d-8e13-4299-931e-0a413c2601e4 req-7a52dc9c-7549-442e-91e8-5813889815c6 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:56.005440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-66af561d-8e13-4299-931e-0a413c2601e4 req-7a52dc9c-7549-442e-91e8-5813889815c6 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:56.016028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-66af561d-8e13-4299-931e-0a413c2601e4 req-7a52dc9c-7549-442e-91e8-5813889815c6 service nova] Creating event network-vif-plugged:599efce6-627c-4cdc-8377-c0e35b0bc4d5 for instance a9db54d4-0810-44c4-aac5-298540bc5521 on hv-cinder-83009 Mar 08 13:21:56.021452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-66af561d-8e13-4299-931e-0a413c2601e4 req-7a52dc9c-7549-442e-91e8-5813889815c6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029188 Mar 08 13:21:56.022035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 207/412] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:56.031846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:56.039153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-97ca4448-1ca1-4a94-a6ea-fee710f242e5 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.171771 Mar 08 13:21:56.039821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 206/413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:55 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:56.370943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:56.371622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:56.378700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:56.379147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:56.379908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:56.380335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:56.515685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:56.523018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f718672c-c580-4461-baa5-042b38fa02a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.156244 Mar 08 13:21:56.523569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 208/414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:56 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:56.887844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:56.888452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:56.895361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:56.895813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:56.896582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:56.897049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:56.973550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8c23fca1-09ea-4cd2-89bb-37e79bca9b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:56.974512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8c23fca1-09ea-4cd2-89bb-37e79bca9b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:56.981106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c23fca1-09ea-4cd2-89bb-37e79bca9b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:56.981629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c23fca1-09ea-4cd2-89bb-37e79bca9b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:56.982322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c23fca1-09ea-4cd2-89bb-37e79bca9b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:56.982753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c23fca1-09ea-4cd2-89bb-37e79bca9b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:57.012337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8c23fca1-09ea-4cd2-89bb-37e79bca9b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 Mar 08 13:21:57.012921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 209/415] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:21:57.031690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:57.040229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:57.041754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:57.042885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-187fe226-aa07-4ef2-beee-53c6c77ec815 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159093 Mar 08 13:21:57.043438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 207/416] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:57.056326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:57.056967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:57.062718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:57.063164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:57.063932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:57.064399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:57.194765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:57.201829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8e1eb5b3-fd30-4bf7-bf1e-3714b5f0170d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1315 microversion: 2.1 time: 0.149242 Mar 08 13:21:57.202379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 210/417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:57 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:57.539615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:57.540214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:57.546048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:57.546519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:57.547267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:57.547698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:57.682338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:57.689599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-89ccc2b1-f8af-4a84-8a07-7e4b8273cda8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.153817 Mar 08 13:21:57.690153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 208/418] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:58.024253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c5880510-848e-44f5-941f-0779c879bb3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:58.025195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c5880510-848e-44f5-941f-0779c879bb3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:58.031541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5880510-848e-44f5-941f-0779c879bb3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.031987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5880510-848e-44f5-941f-0779c879bb3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.032775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5880510-848e-44f5-941f-0779c879bb3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.033309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5880510-848e-44f5-941f-0779c879bb3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.061548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:58.062207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c5880510-848e-44f5-941f-0779c879bb3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041958 Mar 08 13:21:58.062333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:58.062752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 211/419] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:58.069430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.069892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.070640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.071076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.200421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:58.210342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:58.211835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:58.213025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d664584c-ae30-4199-9abe-f34646ce6449 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155343 Mar 08 13:21:58.217429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 209/420] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:21:58.218771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:58.219383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:58.225611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.226089 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.231122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.231122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.363355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:58.370685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f2d75061-8d23-4241-9e61-f9a269a1db0d tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1464 microversion: 2.1 time: 0.155795 Mar 08 13:21:58.371241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 212/421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:58 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:58.408399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:58.408993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:58.415503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.415991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.416793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.417236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.439837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:21:58.652785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b865cdb5-84cc-48f3-82c9-6237dee20c2f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 204 len: 0 microversion: 2.1 time: 0.247881 Mar 08 13:21:58.653378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 210/422] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:21:58 2022] DELETE /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:21:58.669861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:58.669861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:58.669861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.669861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.670276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.670276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.706528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:58.707212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:58.713263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.713715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.714493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:58.714931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:58.801829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:58.809631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b6cc84d-7d8c-438e-85c7-84ebace02800 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1470 microversion: 2.1 time: 0.151994 Mar 08 13:21:58.810279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 213/423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:58 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:21:58.856478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:58.864912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5024db0e-7a5f-4d98-a654-42896e5f4046 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.162555 Mar 08 13:21:58.865476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 211/424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:21:59.074211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ff62eb10-ae04-4402-bea3-af720de1b5f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:59.075120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ff62eb10-ae04-4402-bea3-af720de1b5f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:59.081921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff62eb10-ae04-4402-bea3-af720de1b5f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.082362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff62eb10-ae04-4402-bea3-af720de1b5f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.083114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff62eb10-ae04-4402-bea3-af720de1b5f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.083542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff62eb10-ae04-4402-bea3-af720de1b5f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.110523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ff62eb10-ae04-4402-bea3-af720de1b5f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040248 Mar 08 13:21:59.111061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 214/425] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:21:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:21:59.231260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:59.231798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:59.238838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.239284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.240048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.240486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.371331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:59.379479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:59.381020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:59.382177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-10a1c38f-99e1-42e0-ba7a-43b6a173bd8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154840 Mar 08 13:21:59.382732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 212/426] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:21:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:21:59.827343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:59.827870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:59.834384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.834822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.835572 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.837018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.881577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:21:59.882181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:21:59.888039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.888484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.889280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:21:59.889712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:21:59.972781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:21:59.981125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-41eb6510-0200-40d6-ad87-8786052dcd4f tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1470 microversion: 2.1 time: 0.157644 Mar 08 13:21:59.981697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 215/427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:59 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:00.031704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:00.038998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5da05224-7882-4489-8ed7-d341a6ae3e22 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.161908 Mar 08 13:22:00.039645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 213/428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:21:59 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:00.122352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea78691b-5e52-476c-8dfb-9ad67a226a60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:00.123185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea78691b-5e52-476c-8dfb-9ad67a226a60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:00.130188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea78691b-5e52-476c-8dfb-9ad67a226a60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:00.130634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea78691b-5e52-476c-8dfb-9ad67a226a60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:00.131418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea78691b-5e52-476c-8dfb-9ad67a226a60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:00.131835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea78691b-5e52-476c-8dfb-9ad67a226a60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:00.159749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea78691b-5e52-476c-8dfb-9ad67a226a60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041470 Mar 08 13:22:00.160289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 216/429] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:00.400719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:00.401262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:00.407730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:00.408179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:00.409121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:00.409962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:00.543180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:00.553013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:00.554870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:00.556196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5d67533c-e5c8-4e71-9991-de1c5445f14e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159449 Mar 08 13:22:00.556818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 214/430] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:00 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:00.752192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-d0d05634-b2c9-480b-b912-48ea6d126bf9 req-d4971a9d-1614-4fd9-991d-e36d3a35f0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9db54d4-0810-44c4-aac5-298540bc5521", "name": "network-vif-deleted", "tag": "599efce6-627c-4cdc-8377-c0e35b0bc4d5"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:22:00.761308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-d0d05634-b2c9-480b-b912-48ea6d126bf9 req-d4971a9d-1614-4fd9-991d-e36d3a35f0aa service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:00.766016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-d0d05634-b2c9-480b-b912-48ea6d126bf9 req-d4971a9d-1614-4fd9-991d-e36d3a35f0aa service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:00.773969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-d0d05634-b2c9-480b-b912-48ea6d126bf9 req-d4971a9d-1614-4fd9-991d-e36d3a35f0aa service nova] Creating event network-vif-deleted:599efce6-627c-4cdc-8377-c0e35b0bc4d5 for instance a9db54d4-0810-44c4-aac5-298540bc5521 on hv-cinder-83009 Mar 08 13:22:00.779028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-d0d05634-b2c9-480b-b912-48ea6d126bf9 req-d4971a9d-1614-4fd9-991d-e36d3a35f0aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Mar 08 13:22:00.779627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 217/431] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:00.999168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:00.999756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:01.006556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.007006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.007835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.008274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.038948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.039553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.040004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lazy-loading 'fault' on Instance uuid a9db54d4-0810-44c4-aac5-298540bc5521 {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:22:01.057020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:01.057717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:01.063892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.064340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.065135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.065913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.080871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b524bd502e2e4e38937db3c691e21a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3ba160ad2b455fb1c10adf23c23040', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:01.088767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-990eaaba-8047-4aae-84fe-e56e68712e86 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 200 len: 1305 microversion: 2.1 time: 0.093565 Mar 08 13:22:01.089553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 215/432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:00 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 1305 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:01.170920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ed91153e-0037-4ec3-bdf5-dd35bd3bd21e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:01.171923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ed91153e-0037-4ec3-bdf5-dd35bd3bd21e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:01.178317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed91153e-0037-4ec3-bdf5-dd35bd3bd21e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.178769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed91153e-0037-4ec3-bdf5-dd35bd3bd21e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.179550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed91153e-0037-4ec3-bdf5-dd35bd3bd21e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.179990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed91153e-0037-4ec3-bdf5-dd35bd3bd21e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.212311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ed91153e-0037-4ec3-bdf5-dd35bd3bd21e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Mar 08 13:22:01.212455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:01.213734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 216/433] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:01.220236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b3044338-573c-4a73-ac50-993c563d7d92 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.167426 Mar 08 13:22:01.220856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 218/434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:01.583852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:01.584457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:01.590797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.591578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.592006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:01.592449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:01.727493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:01.735685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:01.737218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:01.739123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1d30e5fa-36fe-4cec-ad76-9721aa4c9852 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159818 Mar 08 13:22:01.739678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 217/435] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:02.106347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:02.106876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] [instance: a9db54d4-0810-44c4-aac5-298540bc5521] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:02.113106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.113620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.114386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.114826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.129629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] HTTP exception thrown: Instance a9db54d4-0810-44c4-aac5-298540bc5521 could not be found. Mar 08 13:22:02.130222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] Returning 404 to user: Instance a9db54d4-0810-44c4-aac5-298540bc5521 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:22:02.131105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-88d60b9a-b2ce-4b11-a4c5-95e07584e543 tempest-VolumesNegativeTest-1508898371 tempest-VolumesNegativeTest-1508898371-project] 10.222.0.52 "GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521" status: 404 len: 111 microversion: 2.1 time: 0.028944 Mar 08 13:22:02.131641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 219/436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:02 2022] GET /compute/v2.1/servers/a9db54d4-0810-44c4-aac5-298540bc5521 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:22:02.223735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-57722854-10ea-40fc-b145-fb5a193cfe47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:02.224693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-57722854-10ea-40fc-b145-fb5a193cfe47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:02.230604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57722854-10ea-40fc-b145-fb5a193cfe47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.231049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57722854-10ea-40fc-b145-fb5a193cfe47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.231883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57722854-10ea-40fc-b145-fb5a193cfe47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.232316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57722854-10ea-40fc-b145-fb5a193cfe47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.236914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:02.238141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:02.244432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.244952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.245744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.246163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.265386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-57722854-10ea-40fc-b145-fb5a193cfe47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045351 Mar 08 13:22:02.269041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 218/437] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:02.383815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:02.391024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5e12be89-aff8-4783-8191-8665dc7e3f16 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.158114 Mar 08 13:22:02.391573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 220/438] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:02.756726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:02.757335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:02.763699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.764153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.768884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:02.768884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:02.900936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:02.909183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:02.911617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:02.912806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a5902e8-296b-4749-af6e-a97783535e61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160054 Mar 08 13:22:02.913659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 219/439] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:03.276455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8d87cd66-86a2-480f-8f88-fe88dc2ef656 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:03.277406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8d87cd66-86a2-480f-8f88-fe88dc2ef656 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:03.283754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d87cd66-86a2-480f-8f88-fe88dc2ef656 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:03.284199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d87cd66-86a2-480f-8f88-fe88dc2ef656 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:03.285689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d87cd66-86a2-480f-8f88-fe88dc2ef656 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:03.286121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d87cd66-86a2-480f-8f88-fe88dc2ef656 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:03.314666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8d87cd66-86a2-480f-8f88-fe88dc2ef656 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 Mar 08 13:22:03.315359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 221/440] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:03.408279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:03.408970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:03.415420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:03.415869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:03.420811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:03.421342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:03.559515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:03.569174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-10b86b17-da22-46d7-b28b-e9c2de2410b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.164585 Mar 08 13:22:03.569865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 220/441] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:03 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:03.931902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:03.932560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:03.938429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:03.938877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:03.939636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:03.940077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:04.074367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:04.082929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:04.084503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:04.085668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bb71a2d4-5a25-42e1-b975-78a1c5a7287f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157673 Mar 08 13:22:04.086227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 222/442] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:22:04.328149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b8c2510b-064c-47ba-8cc2-dfb773dc694c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:04.329099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b8c2510b-064c-47ba-8cc2-dfb773dc694c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:04.336472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8c2510b-064c-47ba-8cc2-dfb773dc694c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:04.337713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8c2510b-064c-47ba-8cc2-dfb773dc694c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:04.339030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8c2510b-064c-47ba-8cc2-dfb773dc694c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:04.339476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8c2510b-064c-47ba-8cc2-dfb773dc694c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:04.380154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b8c2510b-064c-47ba-8cc2-dfb773dc694c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056213 Mar 08 13:22:04.380786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 221/443] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:04.586526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:04.587599 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:04.594527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:04.594975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:04.595747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:04.596179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:04.763394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:04.772421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b7c7ba67-d3cf-43f9-bf33-1d8d09a890bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.189683 Mar 08 13:22:04.773038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 223/444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:05.103640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:05.104251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:05.110427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:05.110881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:05.111652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:05.112088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:05.247690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:05.256692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:05.258320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:05.259478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6ea7309e-0e4c-4cc4-9234-2ac911aaf759 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159680 Mar 08 13:22:05.260031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 222/445] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:22:05.391139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aec7790a-44e7-481e-a109-1385d63d95f1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:05.392108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aec7790a-44e7-481e-a109-1385d63d95f1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:05.399018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec7790a-44e7-481e-a109-1385d63d95f1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:05.399469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec7790a-44e7-481e-a109-1385d63d95f1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:05.400226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec7790a-44e7-481e-a109-1385d63d95f1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:05.400672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec7790a-44e7-481e-a109-1385d63d95f1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:05.429263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aec7790a-44e7-481e-a109-1385d63d95f1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Mar 08 13:22:05.429816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 224/446] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:05.791800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:05.792415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:05.799217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:05.799685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:05.801100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:05.801544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:05.945003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:05.952220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-41e7758e-5eee-4ba1-bb29-350a6a6377ac tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.164310 Mar 08 13:22:05.952802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 223/447] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:06.278568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:06.279171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:06.286337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:06.286943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:06.287732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:06.288176 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:06.439890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-48e070e4-2d4f-4bdc-aca5-d37eee84803b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:06.441842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-48e070e4-2d4f-4bdc-aca5-d37eee84803b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:06.447898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48e070e4-2d4f-4bdc-aca5-d37eee84803b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:06.448344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48e070e4-2d4f-4bdc-aca5-d37eee84803b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:06.449148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48e070e4-2d4f-4bdc-aca5-d37eee84803b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:06.449575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48e070e4-2d4f-4bdc-aca5-d37eee84803b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:06.454866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:06.468278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:06.469713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:06.471301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7fe38ae4-8467-4a69-a5cc-39744c630f0f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.196339 Mar 08 13:22:06.480302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 225/448] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:06.480465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-48e070e4-2d4f-4bdc-aca5-d37eee84803b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Mar 08 13:22:06.480465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 224/449] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:06.970462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:06.971079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:06.978484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:06.978970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:06.979737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:06.980171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:07.119142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:07.126355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-016d5f8e-94bc-4c50-a330-d5f3c4e90c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.160211 Mar 08 13:22:07.126907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 226/450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:06 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:07.491123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:07.491658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b740496c-cb88-4f5a-b87b-1546a50bc4e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:07.492063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:07.492160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b740496c-cb88-4f5a-b87b-1546a50bc4e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:07.498217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:07.498571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b740496c-cb88-4f5a-b87b-1546a50bc4e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:07.498688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:07.499012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b740496c-cb88-4f5a-b87b-1546a50bc4e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:07.499423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:07.499790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b740496c-cb88-4f5a-b87b-1546a50bc4e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:07.499889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:07.500229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b740496c-cb88-4f5a-b87b-1546a50bc4e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:07.528982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b740496c-cb88-4f5a-b87b-1546a50bc4e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 Mar 08 13:22:07.529544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 227/451] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:07.656784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:07.669916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:07.672365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:07.674201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1c71d991-f6f8-4405-abfa-2b8d3d423d93 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.187001 Mar 08 13:22:07.675036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 225/452] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:07 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:08.143108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:08.143739 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:08.150196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:08.150643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:08.151397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:08.151827 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:08.282582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:08.290141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8d0b56ec-3917-423f-81b2-ea73eddd0102 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.150947 Mar 08 13:22:08.290705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 228/453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:08 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:08.541044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d1f72560-80ca-4148-a754-0153987c074e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:08.541922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d1f72560-80ca-4148-a754-0153987c074e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:08.548088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1f72560-80ca-4148-a754-0153987c074e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:08.548540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1f72560-80ca-4148-a754-0153987c074e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:08.549342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1f72560-80ca-4148-a754-0153987c074e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:08.549805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1f72560-80ca-4148-a754-0153987c074e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:08.577179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d1f72560-80ca-4148-a754-0153987c074e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040309 Mar 08 13:22:08.577722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 226/454] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:08.698158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:08.698756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:08.705021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:08.705464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:08.706217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:08.706648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:08.840103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:08.848477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:08.850016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:08.851302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4ee114e3-c090-44b7-8218-c27eba20b137 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156853 Mar 08 13:22:08.851865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 229/455] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:09.307265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:09.307882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:09.313781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:09.314234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:09.315002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:09.315440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:09.445811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:09.452974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0a254de3-4626-4e4f-86c3-e6352a1c50d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.149515 Mar 08 13:22:09.453538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 227/456] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:09.588978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-858c5d47-4bcb-497e-8136-8c4c4a1c0b52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:09.590454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-858c5d47-4bcb-497e-8136-8c4c4a1c0b52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:09.601096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-858c5d47-4bcb-497e-8136-8c4c4a1c0b52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:09.601762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-858c5d47-4bcb-497e-8136-8c4c4a1c0b52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:09.602792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-858c5d47-4bcb-497e-8136-8c4c4a1c0b52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:09.603227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-858c5d47-4bcb-497e-8136-8c4c4a1c0b52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:09.632146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-858c5d47-4bcb-497e-8136-8c4c4a1c0b52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Mar 08 13:22:09.632707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 230/457] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:09.869975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:09.870585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:09.876887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:09.877334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:09.878096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:09.878533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:10.006419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:10.014718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:10.016245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:10.017451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-38ad8ad2-5e91-4e4e-925b-0c76e21884e9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151412 Mar 08 13:22:10.018215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 228/458] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:10.468787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:10.469390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:10.475705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:10.476148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:10.476939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:10.477365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:10.609438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:10.617092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-24bf1a22-90b7-41b4-aa0e-b9d0352206ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.152168 Mar 08 13:22:10.617642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 231/459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:10.643238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f1568921-c86b-416c-8d68-0b0919152591 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:10.644138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f1568921-c86b-416c-8d68-0b0919152591 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:10.650131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1568921-c86b-416c-8d68-0b0919152591 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:10.650580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1568921-c86b-416c-8d68-0b0919152591 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:10.651336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1568921-c86b-416c-8d68-0b0919152591 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:10.651774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1568921-c86b-416c-8d68-0b0919152591 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:10.678959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f1568921-c86b-416c-8d68-0b0919152591 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039576 Mar 08 13:22:10.679499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 229/460] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:11.037961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:11.038566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:11.044422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:11.044915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:11.045678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:11.046115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:11.175844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:11.184365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:11.185938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:11.187085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-350fa73b-7a27-4cfa-b5e1-98cea969b823 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153787 Mar 08 13:22:11.187671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 232/461] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:11.634471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:11.635083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:11.641317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:11.641772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:11.642539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:11.643010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:11.690813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6fbef401-fc5f-4002-8dfb-0a75000d99f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:11.692566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6fbef401-fc5f-4002-8dfb-0a75000d99f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:11.699078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbef401-fc5f-4002-8dfb-0a75000d99f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:11.699524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbef401-fc5f-4002-8dfb-0a75000d99f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:11.700282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbef401-fc5f-4002-8dfb-0a75000d99f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:11.700811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbef401-fc5f-4002-8dfb-0a75000d99f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:11.730019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6fbef401-fc5f-4002-8dfb-0a75000d99f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043152 Mar 08 13:22:11.730774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 233/462] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:11.780645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:11.787833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5187ce17-e27d-4dd2-863b-a107c82f7fef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.157408 Mar 08 13:22:11.788394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 230/463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:11 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:12.205467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:12.206084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:12.212597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.213078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.213840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.214280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.348559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:12.356881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:12.358319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:12.359475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2ea93a2e-465a-4f88-b98e-9e3e96bfa0e1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157898 Mar 08 13:22:12.360024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 234/464] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:12.529396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aafffd33-56fc-4304-a774-8128fbe0de2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:12.529892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aafffd33-56fc-4304-a774-8128fbe0de2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:12.536556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aafffd33-56fc-4304-a774-8128fbe0de2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.537036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aafffd33-56fc-4304-a774-8128fbe0de2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.537804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aafffd33-56fc-4304-a774-8128fbe0de2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.538243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aafffd33-56fc-4304-a774-8128fbe0de2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.562319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aafffd33-56fc-4304-a774-8128fbe0de2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e/ips" status: 200 len: 150 microversion: 2.1 time: 0.036777 Mar 08 13:22:12.562886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 231/465] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:22:12 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:12.573394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "314c5589-7a57-4a18-a54e-0c7841dd6600"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:22:12.574467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:12.580289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.580773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.581529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.581966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.660304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Invalid volume: volume 314c5589-7a57-4a18-a54e-0c7841dd6600 is already attached to instances: 701ec119-507b-4b00-b365-bb76f36feab1 Mar 08 13:22:12.660304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 400 to user: Invalid volume: volume 314c5589-7a57-4a18-a54e-0c7841dd6600 is already attached to instances: 701ec119-507b-4b00-b365-bb76f36feab1 {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:22:12.660304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-735047ba-b687-4787-854a-7a21735ac4c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.090285 Mar 08 13:22:12.660304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 235/466] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:22:12 2022] POST /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:22:12.669610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:12.670240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:12.677461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.677912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.678693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.679128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.704461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:22:12.741566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6fbf2c22-520b-4152-a00c-f44bd0b58e69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:12.742533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6fbf2c22-520b-4152-a00c-f44bd0b58e69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:12.749601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbf2c22-520b-4152-a00c-f44bd0b58e69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.750048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbf2c22-520b-4152-a00c-f44bd0b58e69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.750807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbf2c22-520b-4152-a00c-f44bd0b58e69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.751239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fbf2c22-520b-4152-a00c-f44bd0b58e69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.780267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6fbf2c22-520b-4152-a00c-f44bd0b58e69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043259 Mar 08 13:22:12.780935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 236/467] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:12.804240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:12.804908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:12.810758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.811207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.812016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:12.812450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:12.951916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:12.960023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e6b3475a-c910-4198-9d00-0d962b4d7974 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.160398 Mar 08 13:22:12.960584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 237/468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:12.991836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-690b35bc-65a6-44fe-961b-3f1908b51b0a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 204 len: 0 microversion: 2.1 time: 0.325841 Mar 08 13:22:12.992448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 232/469] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:22:12 2022] DELETE /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:22:13.000349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:13.000999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:13.006968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.007425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:13.008198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.008640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:13.142706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:13.151056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-11ac4abb-d773-41e3-9f2f-574a6bac4357 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1682 microversion: 2.1 time: 0.154371 Mar 08 13:22:13.151617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 238/470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:12 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:13.378242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:13.378930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:13.384854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.385299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:13.386047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.386479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:13.517735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:13.526521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:13.528014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:13.529198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-391888d3-0ea8-4335-be66-88dcbd5747f4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155146 Mar 08 13:22:13.529755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 233/471] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:13.792359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-110e8007-f953-495c-8b00-2c9e78e86d44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:13.793267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-110e8007-f953-495c-8b00-2c9e78e86d44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:13.799501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-110e8007-f953-495c-8b00-2c9e78e86d44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.799952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-110e8007-f953-495c-8b00-2c9e78e86d44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:13.800734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-110e8007-f953-495c-8b00-2c9e78e86d44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.801791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-110e8007-f953-495c-8b00-2c9e78e86d44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:13.834514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-110e8007-f953-495c-8b00-2c9e78e86d44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Mar 08 13:22:13.835058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 239/472] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:13.977132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:13.977734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:13.984013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.984455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:13.985239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:13.985670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:14.121005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:14.128308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5d12cbc8-88dc-459a-bf01-4bae08bb76a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.155586 Mar 08 13:22:14.128922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 234/473] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:14.167697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:14.168297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:14.174101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:14.174542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:14.175292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:14.175722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:14.305739 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:14.312991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b5f3ad86-973d-4ca0-a9d8-7a584605e38f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1682 microversion: 2.1 time: 0.149092 Mar 08 13:22:14.313553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 240/474] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:14 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:14.547670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:14.548279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:14.554291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:14.554741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:14.555492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:14.555926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:14.686442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:14.694742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:14.696240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:14.697412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-722f8192-ac6a-4f85-abb9-05802805d84c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153631 Mar 08 13:22:14.697968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 235/475] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:14 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:14.845453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dfb33b4e-89ba-48e3-b9b5-8ed7840d2ca8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:14.846410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dfb33b4e-89ba-48e3-b9b5-8ed7840d2ca8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:14.853459 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb33b4e-89ba-48e3-b9b5-8ed7840d2ca8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:14.853908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb33b4e-89ba-48e3-b9b5-8ed7840d2ca8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:14.854685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb33b4e-89ba-48e3-b9b5-8ed7840d2ca8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:14.855121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb33b4e-89ba-48e3-b9b5-8ed7840d2ca8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:14.885252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dfb33b4e-89ba-48e3-b9b5-8ed7840d2ca8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043824 Mar 08 13:22:14.885879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 241/476] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:15.143870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:15.144427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:15.150987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.151430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.152181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.152640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.305825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:15.314662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-25e19034-7d8b-45be-9682-86056fea1aa0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.174631 Mar 08 13:22:15.315268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 236/477] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:15 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:15.331127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:15.332011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:15.339053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.339716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.340639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.341113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.424891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:15.433104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9d1f49a1-b09d-4535-87c6-eadcf654929d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1614 microversion: 2.1 time: 0.105682 Mar 08 13:22:15.433676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 242/478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:15 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:15.545794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-7fbed071-ca61-49cd-bcb7-de6dfaa7306d req-efac49dc-cf03-41d7-a42e-bbd13ffe3652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f74deff-dd51-47b8-9015-5120e8f0106e", "name": "network-vif-deleted", "tag": "caf93497-f9e2-4e24-8a43-bc0cbf8ce269"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:22:15.558507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-7fbed071-ca61-49cd-bcb7-de6dfaa7306d req-efac49dc-cf03-41d7-a42e-bbd13ffe3652 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.559103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-7fbed071-ca61-49cd-bcb7-de6dfaa7306d req-efac49dc-cf03-41d7-a42e-bbd13ffe3652 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.570974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-7fbed071-ca61-49cd-bcb7-de6dfaa7306d req-efac49dc-cf03-41d7-a42e-bbd13ffe3652 service nova] Creating event network-vif-deleted:caf93497-f9e2-4e24-8a43-bc0cbf8ce269 for instance 8f74deff-dd51-47b8-9015-5120e8f0106e on hv-cinder-83009 Mar 08 13:22:15.576004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-7fbed071-ca61-49cd-bcb7-de6dfaa7306d req-efac49dc-cf03-41d7-a42e-bbd13ffe3652 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033973 Mar 08 13:22:15.576729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 237/479] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:15.715350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:15.716099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:15.725569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.728091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.728965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.729492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.869706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:15.880252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:15.881913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:15.883412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-00951ddc-160b-47bc-a5fb-1439cec06dd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.171933 Mar 08 13:22:15.884128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 243/480] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:15.898032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0fd3d3f6-5a25-40c7-bcb5-5bb82cb5afdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:15.899120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0fd3d3f6-5a25-40c7-bcb5-5bb82cb5afdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:15.905288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fd3d3f6-5a25-40c7-bcb5-5bb82cb5afdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.905814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fd3d3f6-5a25-40c7-bcb5-5bb82cb5afdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.906599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fd3d3f6-5a25-40c7-bcb5-5bb82cb5afdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:15.907040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fd3d3f6-5a25-40c7-bcb5-5bb82cb5afdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:15.937246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0fd3d3f6-5a25-40c7-bcb5-5bb82cb5afdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Mar 08 13:22:15.940735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 238/481] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:16.331734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:16.332810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:16.339787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.340539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.341658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.342323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.461389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:16.464127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:16.471157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.471937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.472989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.476906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.514475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:16.526280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-960a738d-d38a-4e22-bc4a-29a657afb779 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.198361 Mar 08 13:22:16.527185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 244/482] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:16.534283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.534807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.535327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lazy-loading 'fault' on Instance uuid 8f74deff-dd51-47b8-9015-5120e8f0106e {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:22:16.588409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:16.596209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1ffd279b-3132-4fdf-922d-8d5865b46aa7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 200 len: 1331 microversion: 2.1 time: 0.149162 Mar 08 13:22:16.596804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 239/483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:16 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 1331 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:16.902502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:16.903138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:16.909495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.909997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.910739 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.911179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.949419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b42231a3-f0a7-43c3-9d77-670d2ac9b56f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:16.951503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b42231a3-f0a7-43c3-9d77-670d2ac9b56f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:16.964121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b42231a3-f0a7-43c3-9d77-670d2ac9b56f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.965095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b42231a3-f0a7-43c3-9d77-670d2ac9b56f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:16.965826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b42231a3-f0a7-43c3-9d77-670d2ac9b56f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:16.966363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b42231a3-f0a7-43c3-9d77-670d2ac9b56f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:17.016871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b42231a3-f0a7-43c3-9d77-670d2ac9b56f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069660 Mar 08 13:22:17.016871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 240/484] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:17.057532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:17.066003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:17.068223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:17.069408 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aac91411-46e3-437a-afe5-4faa5d8cd6e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.170854 Mar 08 13:22:17.070189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 245/485] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:17.542971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:17.543580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:17.549442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:17.549887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:17.550637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:17.551069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:17.613180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:17.613847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:17.620427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:17.620936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:17.621760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:17.622200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:17.636220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 8f74deff-dd51-47b8-9015-5120e8f0106e could not be found. Mar 08 13:22:17.636863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 8f74deff-dd51-47b8-9015-5120e8f0106e could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:22:17.637690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b4373c29-067f-4734-9cb9-2cb41f683811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 404 len: 111 microversion: 2.1 time: 0.028565 Mar 08 13:22:17.638233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 246/486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:17 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:22:17.647710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-59249ec0-cb40-441a-adb3-0661de450b09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '.version_select at 0x7f5e2d424d30>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:17.699131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:17.706574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5aec6494-db01-452f-a649-305afc3ad700 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.167451 Mar 08 13:22:17.707139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 241/487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:17 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:17.736607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-59249ec0-cb40-441a-adb3-0661de450b09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-256273803" status: 202 len: 0 microversion: 2.1 time: 0.093725 Mar 08 13:22:17.738013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 247/488] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Mar 8 13:22:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-256273803 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 13:22:18.027247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ec2879e2-8d52-4f4d-8df2-d672c20f28ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:18.028259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ec2879e2-8d52-4f4d-8df2-d672c20f28ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:18.045847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec2879e2-8d52-4f4d-8df2-d672c20f28ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.046346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec2879e2-8d52-4f4d-8df2-d672c20f28ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.047180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec2879e2-8d52-4f4d-8df2-d672c20f28ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.047620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec2879e2-8d52-4f4d-8df2-d672c20f28ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.086634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ec2879e2-8d52-4f4d-8df2-d672c20f28ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063412 Mar 08 13:22:18.087522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 242/489] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:18.088581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:18.089228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:18.096411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.096907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.097693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.098135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.238499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:18.249053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:18.250683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:18.252014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2081e7c5-5ffe-4b49-8166-d8fc214b8fcb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.167631 Mar 08 13:22:18.252831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 248/490] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:18.615505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:18.616091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:18.621796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.622247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.623008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.623445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.723337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:18.723963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:18.730009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.730717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.731501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:18.731941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:18.750333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lazy-loading 'services' on Instance uuid 701ec119-507b-4b00-b365-bb76f36feab1 {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:22:18.877324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:18.884647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ac902f23-653d-4ea1-b8e2-e58c10a20bed tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.165152 Mar 08 13:22:18.885294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 249/491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:19.058066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0619470-c57f-44c3-8c9b-e99dc1c2a2ea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments/314c5589-7a57-4a18-a54e-0c7841dd6600" status: 202 len: 0 microversion: 2.1 time: 0.446665 Mar 08 13:22:19.058685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 243/492] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:22:18 2022] DELETE /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments/314c5589-7a57-4a18-a54e-0c7841dd6600 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:22:19.071492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e661eeb6-7bc9-4190-8993-e22449d8a48d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:19.072341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e661eeb6-7bc9-4190-8993-e22449d8a48d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:19.079059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661eeb6-7bc9-4190-8993-e22449d8a48d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.079505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661eeb6-7bc9-4190-8993-e22449d8a48d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:19.080275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661eeb6-7bc9-4190-8993-e22449d8a48d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.080734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661eeb6-7bc9-4190-8993-e22449d8a48d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:19.099036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-811569d5-440e-4d73-88fd-965061717acb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:19.100095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-811569d5-440e-4d73-88fd-965061717acb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:19.106119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-811569d5-440e-4d73-88fd-965061717acb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.106571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-811569d5-440e-4d73-88fd-965061717acb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:19.107351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-811569d5-440e-4d73-88fd-965061717acb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.107786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-811569d5-440e-4d73-88fd-965061717acb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:19.113196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e661eeb6-7bc9-4190-8993-e22449d8a48d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050040 Mar 08 13:22:19.114061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 250/493] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:19.137860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-811569d5-440e-4d73-88fd-965061717acb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Mar 08 13:22:19.138411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 244/494] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:19.271397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:19.272084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:19.278616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.279127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:19.280029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.280510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:19.418051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:19.427241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:19.428975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:19.430264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-45a93d54-91a3-4c95-bc42-93f4ca781ec0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163486 Mar 08 13:22:19.430896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 251/495] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:19.902003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:19.902608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:19.908768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.909301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:19.910080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:19.910517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:20.047990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:20.055191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f84f8043-04d6-43c9-aeae-49e6bcecac7d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.157029 Mar 08 13:22:20.055762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 245/496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:20.127829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5857d459-d769-44b4-9b68-4faeda3036f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:20.128806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5857d459-d769-44b4-9b68-4faeda3036f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:20.136225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5857d459-d769-44b4-9b68-4faeda3036f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:20.138022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5857d459-d769-44b4-9b68-4faeda3036f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:20.138816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5857d459-d769-44b4-9b68-4faeda3036f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:20.139255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5857d459-d769-44b4-9b68-4faeda3036f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:20.150810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8e72c058-7c87-4596-84a3-d81dc1afa19e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:20.151798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8e72c058-7c87-4596-84a3-d81dc1afa19e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:20.157748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e72c058-7c87-4596-84a3-d81dc1afa19e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:20.158194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e72c058-7c87-4596-84a3-d81dc1afa19e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:20.158964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e72c058-7c87-4596-84a3-d81dc1afa19e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:20.159401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e72c058-7c87-4596-84a3-d81dc1afa19e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:20.172467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5857d459-d769-44b4-9b68-4faeda3036f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048709 Mar 08 13:22:20.173059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 252/497] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:20.192055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8e72c058-7c87-4596-84a3-d81dc1afa19e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Mar 08 13:22:20.193258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 246/498] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:20.449945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:20.450626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:20.456474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:20.456981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:20.457768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:20.458333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:20.589918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:20.598072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:20.600337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:20.601521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-af7b3afc-04e0-47ff-88f3-438a579f0d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155584 Mar 08 13:22:20.602070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 253/499] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:21.071737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:21.072393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:21.079240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.079693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.080464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.080934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.184075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f2d0d329-4905-4392-a576-f6b8d31457db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:21.185101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f2d0d329-4905-4392-a576-f6b8d31457db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:21.191467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0d329-4905-4392-a576-f6b8d31457db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.191995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0d329-4905-4392-a576-f6b8d31457db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.192890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0d329-4905-4392-a576-f6b8d31457db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.193935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0d329-4905-4392-a576-f6b8d31457db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.216517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:21.224099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ab21162b-9440-409a-a660-7ba7da64d312 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.156478 Mar 08 13:22:21.224591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f2d0d329-4905-4392-a576-f6b8d31457db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Mar 08 13:22:21.228525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 247/500] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:21.228717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 254/501] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:21.229612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cdde5f19-1e8a-4453-952d-7b8a38886d29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:21.230504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cdde5f19-1e8a-4453-952d-7b8a38886d29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:21.236112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdde5f19-1e8a-4453-952d-7b8a38886d29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.236561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdde5f19-1e8a-4453-952d-7b8a38886d29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.237356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdde5f19-1e8a-4453-952d-7b8a38886d29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.237791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdde5f19-1e8a-4453-952d-7b8a38886d29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.266666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cdde5f19-1e8a-4453-952d-7b8a38886d29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040660 Mar 08 13:22:21.267209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 248/502] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:21.620151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:21.620720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:21.626640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.627090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.627850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:21.628284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:21.760531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:21.768971 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:21.770460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:21.771747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bef29741-f827-4c6c-a2d5-cdb6d85a8fd7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155485 Mar 08 13:22:21.772498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 255/503] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:22.236455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a10a929-c9b3-4fda-af1b-91f03e4c5401 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:22.237312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a10a929-c9b3-4fda-af1b-91f03e4c5401 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:22.240754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:22.241372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:22.244562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a10a929-c9b3-4fda-af1b-91f03e4c5401 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.245049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a10a929-c9b3-4fda-af1b-91f03e4c5401 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.245820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a10a929-c9b3-4fda-af1b-91f03e4c5401 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.246258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a10a929-c9b3-4fda-af1b-91f03e4c5401 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.247488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.247938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.248723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.249163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.274623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a10a929-c9b3-4fda-af1b-91f03e4c5401 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042194 Mar 08 13:22:22.275191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 249/504] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:22.279690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ce424651-7a0d-458e-8f3a-94b14e3933a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:22.280576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ce424651-7a0d-458e-8f3a-94b14e3933a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:22.286308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce424651-7a0d-458e-8f3a-94b14e3933a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.286756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce424651-7a0d-458e-8f3a-94b14e3933a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.288162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce424651-7a0d-458e-8f3a-94b14e3933a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.288605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce424651-7a0d-458e-8f3a-94b14e3933a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.317553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ce424651-7a0d-458e-8f3a-94b14e3933a9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041325 Mar 08 13:22:22.318851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 250/505] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:22.388000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:22.395264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-41d30c89-3654-48b4-b696-151e43612601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.159178 Mar 08 13:22:22.395822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 256/506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:22 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:22.651901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:22:22.654443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:22:22.790129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:22.790727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:22.796599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.797073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.797830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:22.798266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:22.931195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:22.939383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:22.940907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:22.942049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-85e040b6-f17f-47a8-a13a-410dbede7b9b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156157 Mar 08 13:22:22.942591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 251/507] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:23.286532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-abbb444c-5e1f-4008-87b4-b96ef0d9f32c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:23.287447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-abbb444c-5e1f-4008-87b4-b96ef0d9f32c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:23.293746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abbb444c-5e1f-4008-87b4-b96ef0d9f32c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.294192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abbb444c-5e1f-4008-87b4-b96ef0d9f32c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:23.294953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abbb444c-5e1f-4008-87b4-b96ef0d9f32c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.295387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abbb444c-5e1f-4008-87b4-b96ef0d9f32c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:23.324092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-abbb444c-5e1f-4008-87b4-b96ef0d9f32c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041449 Mar 08 13:22:23.324580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 257/508] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:23.329529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-79a05b07-1549-47c8-8124-db487bf1902d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:23.330481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79a05b07-1549-47c8-8124-db487bf1902d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:23.336690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79a05b07-1549-47c8-8124-db487bf1902d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.337153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79a05b07-1549-47c8-8124-db487bf1902d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:23.337911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79a05b07-1549-47c8-8124-db487bf1902d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.338340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79a05b07-1549-47c8-8124-db487bf1902d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:23.367013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-79a05b07-1549-47c8-8124-db487bf1902d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041286 Mar 08 13:22:23.367564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 252/509] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:23.413230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:23.413768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:23.419798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.420241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:23.421037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.421470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:23.562536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:23.569921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a748c388-c430-42a3-aa72-510ce4096d73 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.161066 Mar 08 13:22:23.570469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 258/510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:23 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:23.961355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:23.963959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:23.967859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.968306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:23.969108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:23.969543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:24.098181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:24.106428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:24.107931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:24.109099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a7ee01f0-bd61-451e-b08f-b9167f4d6426 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152275 Mar 08 13:22:24.109650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 253/511] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:24.335514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-726b8d93-f8e1-43cf-93d8-86bcd9f61e65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:24.336424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-726b8d93-f8e1-43cf-93d8-86bcd9f61e65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:24.343014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-726b8d93-f8e1-43cf-93d8-86bcd9f61e65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:24.343462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-726b8d93-f8e1-43cf-93d8-86bcd9f61e65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:24.344228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-726b8d93-f8e1-43cf-93d8-86bcd9f61e65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:24.344739 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-726b8d93-f8e1-43cf-93d8-86bcd9f61e65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:24.373700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-726b8d93-f8e1-43cf-93d8-86bcd9f61e65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041946 Mar 08 13:22:24.374239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 259/512] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:24.378378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2f6a28d6-fb31-444c-8516-b23a65799b50 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:24.379315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2f6a28d6-fb31-444c-8516-b23a65799b50 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:24.385641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f6a28d6-fb31-444c-8516-b23a65799b50 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:24.386105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f6a28d6-fb31-444c-8516-b23a65799b50 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:24.386857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f6a28d6-fb31-444c-8516-b23a65799b50 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:24.387318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f6a28d6-fb31-444c-8516-b23a65799b50 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:24.415316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2f6a28d6-fb31-444c-8516-b23a65799b50 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040774 Mar 08 13:22:24.415858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 254/513] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:24.586415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:24.586960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:24.592896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:24.593350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:24.594115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:24.594549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:24.732010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:24.739291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8cc5b589-8715-4bcf-b2d5-4e5cd9a28f71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.156837 Mar 08 13:22:24.740134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 260/514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:25.127892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:25.128496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:25.135000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.135453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.136244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.136739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.270552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:25.279973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:25.281524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:25.282679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9688845a-e1f6-4a6c-ae4a-1b68e4a6c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158676 Mar 08 13:22:25.283226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 255/515] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:25.384962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d577575e-a1ba-4ab7-a477-01be239cf925 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:25.385856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d577575e-a1ba-4ab7-a477-01be239cf925 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:25.392133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d577575e-a1ba-4ab7-a477-01be239cf925 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.392585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d577575e-a1ba-4ab7-a477-01be239cf925 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.393379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d577575e-a1ba-4ab7-a477-01be239cf925 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.393817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d577575e-a1ba-4ab7-a477-01be239cf925 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.422940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d577575e-a1ba-4ab7-a477-01be239cf925 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Mar 08 13:22:25.423484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 261/516] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:25.427040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8adf72d3-393b-4076-a502-4e447e43e8f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:25.428502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8adf72d3-393b-4076-a502-4e447e43e8f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:25.434750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8adf72d3-393b-4076-a502-4e447e43e8f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.435199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8adf72d3-393b-4076-a502-4e447e43e8f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.435958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8adf72d3-393b-4076-a502-4e447e43e8f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.436390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8adf72d3-393b-4076-a502-4e447e43e8f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.464844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8adf72d3-393b-4076-a502-4e447e43e8f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 Mar 08 13:22:25.465380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 256/517] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:25.755356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:25.757608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:25.763988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.764440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.765253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:25.765684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:25.909919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:25.918143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a5f659a-7276-4158-9102-fdae37213910 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.166675 Mar 08 13:22:25.919689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 262/518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:26.300410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:26.301089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:26.307545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.307993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:26.308798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.309227 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:26.435091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5d04de17-b364-413f-90c7-3b586efc0311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:26.436043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5d04de17-b364-413f-90c7-3b586efc0311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:26.442364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d04de17-b364-413f-90c7-3b586efc0311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.442817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d04de17-b364-413f-90c7-3b586efc0311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:26.443149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:26.444279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d04de17-b364-413f-90c7-3b586efc0311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.444578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d04de17-b364-413f-90c7-3b586efc0311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:26.452348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:26.453896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:26.455041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e7229584-67af-45cb-b189-46b067d6d38b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158444 Mar 08 13:22:26.455793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 257/519] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:26.472913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5d04de17-b364-413f-90c7-3b586efc0311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Mar 08 13:22:26.473468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 263/520] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:26.477657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-38cc4d88-ab6c-4fa7-bb41-b36524dcc2ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:26.479250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-38cc4d88-ab6c-4fa7-bb41-b36524dcc2ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:26.488351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38cc4d88-ab6c-4fa7-bb41-b36524dcc2ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.488846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38cc4d88-ab6c-4fa7-bb41-b36524dcc2ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:26.489680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38cc4d88-ab6c-4fa7-bb41-b36524dcc2ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.490986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-38cc4d88-ab6c-4fa7-bb41-b36524dcc2ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:26.519961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-38cc4d88-ab6c-4fa7-bb41-b36524dcc2ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047364 Mar 08 13:22:26.520496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 258/521] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:26.934529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:26.935141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:26.941203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.941651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:26.942410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:26.942844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:27.077109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:27.084939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ef492636-0fbc-46d2-896a-8d2dfe94359d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.153739 Mar 08 13:22:27.085691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 264/522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:27.473645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:27.474277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:27.480591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:27.481063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:27.481822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:27.482254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:27.483315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3ecd0563-5dd5-4655-9aca-664eb3cb97c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:27.484212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3ecd0563-5dd5-4655-9aca-664eb3cb97c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:27.490804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ecd0563-5dd5-4655-9aca-664eb3cb97c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:27.491391 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ecd0563-5dd5-4655-9aca-664eb3cb97c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:27.492151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ecd0563-5dd5-4655-9aca-664eb3cb97c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:27.492582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ecd0563-5dd5-4655-9aca-664eb3cb97c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:27.523337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3ecd0563-5dd5-4655-9aca-664eb3cb97c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Mar 08 13:22:27.523904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 265/523] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:27.530975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2f2c94df-b8de-4c8b-9229-f7df7759d7bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:27.531871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2f2c94df-b8de-4c8b-9229-f7df7759d7bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:27.537941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f2c94df-b8de-4c8b-9229-f7df7759d7bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:27.538331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f2c94df-b8de-4c8b-9229-f7df7759d7bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:27.539093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f2c94df-b8de-4c8b-9229-f7df7759d7bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:27.539511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f2c94df-b8de-4c8b-9229-f7df7759d7bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:27.574938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2f2c94df-b8de-4c8b-9229-f7df7759d7bf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047600 Mar 08 13:22:27.575509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 266/524] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:27.614957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:27.623548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:27.625091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:27.626246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b93d24c1-1a29-4e80-8261-6bcb7a5fe131 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156520 Mar 08 13:22:27.626813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 259/525] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:28.102089 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:28.102661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:28.108463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.108958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.109723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.110150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.241754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:28.249158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-28c7ecc2-fa15-4bc3-b289-b2639a48a3b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.151309 Mar 08 13:22:28.249712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 267/526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:28.534405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62b404b4-120a-4a08-be8d-ce32d1a14d7b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:28.535318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-62b404b4-120a-4a08-be8d-ce32d1a14d7b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:28.541789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62b404b4-120a-4a08-be8d-ce32d1a14d7b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.542241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62b404b4-120a-4a08-be8d-ce32d1a14d7b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.543010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62b404b4-120a-4a08-be8d-ce32d1a14d7b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.543446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62b404b4-120a-4a08-be8d-ce32d1a14d7b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.571724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-62b404b4-120a-4a08-be8d-ce32d1a14d7b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041271 Mar 08 13:22:28.572263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 260/527] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:28.586272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4543335d-72d0-4ded-84d9-cffc42116aa7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:28.587181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4543335d-72d0-4ded-84d9-cffc42116aa7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:28.593481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4543335d-72d0-4ded-84d9-cffc42116aa7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.593929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4543335d-72d0-4ded-84d9-cffc42116aa7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.594688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4543335d-72d0-4ded-84d9-cffc42116aa7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.595121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4543335d-72d0-4ded-84d9-cffc42116aa7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.623453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4543335d-72d0-4ded-84d9-cffc42116aa7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041166 Mar 08 13:22:28.623924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 268/528] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:28.644736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:28.645344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:28.651336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.651793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.652566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:28.653043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:28.784028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:28.792815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:28.794409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:28.795563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0ad1679f-b05e-429b-a39c-f35e21810872 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154712 Mar 08 13:22:28.796124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 261/529] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:29.265815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:29.266426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:29.272918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.273366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.274126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.274559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.405833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:29.413718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-74c7c7e8-910c-4f83-968d-a6ae2cba1bc3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.151562 Mar 08 13:22:29.414183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 269/530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:29 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:29.583285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-973786cf-16d0-4cee-9ba3-a5576567f278 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:29.584832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-973786cf-16d0-4cee-9ba3-a5576567f278 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:29.591194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973786cf-16d0-4cee-9ba3-a5576567f278 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.591593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973786cf-16d0-4cee-9ba3-a5576567f278 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.592363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973786cf-16d0-4cee-9ba3-a5576567f278 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.592833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973786cf-16d0-4cee-9ba3-a5576567f278 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.620956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-973786cf-16d0-4cee-9ba3-a5576567f278 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041507 Mar 08 13:22:29.621502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 262/531] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:29.635285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a1a9f9e0-3c0a-467d-8db7-8a0c5f2a5dbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:29.636272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a1a9f9e0-3c0a-467d-8db7-8a0c5f2a5dbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:29.642805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1a9f9e0-3c0a-467d-8db7-8a0c5f2a5dbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.643258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1a9f9e0-3c0a-467d-8db7-8a0c5f2a5dbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.644012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1a9f9e0-3c0a-467d-8db7-8a0c5f2a5dbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.644441 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1a9f9e0-3c0a-467d-8db7-8a0c5f2a5dbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.673149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a1a9f9e0-3c0a-467d-8db7-8a0c5f2a5dbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042427 Mar 08 13:22:29.673686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 270/532] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:29.814487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:29.815091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:29.821688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.822139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.822904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:29.823342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:29.953169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:29.961413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:29.962913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:29.964060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7aff2168-c36a-47fd-b422-709c162ebcc1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153471 Mar 08 13:22:29.964619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 263/533] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:30.430936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:30.431548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:30.437380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.437836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:30.438606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.439043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:30.573751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:30.580946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e439e11a-ca45-49af-ba27-855014ee2d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.154515 Mar 08 13:22:30.581511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 271/534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:30.632349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f4a9509-0c1f-4905-b3f4-21b98f8dd64c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:30.633214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f4a9509-0c1f-4905-b3f4-21b98f8dd64c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:30.639316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f4a9509-0c1f-4905-b3f4-21b98f8dd64c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.639756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f4a9509-0c1f-4905-b3f4-21b98f8dd64c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:30.640504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f4a9509-0c1f-4905-b3f4-21b98f8dd64c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.640958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f4a9509-0c1f-4905-b3f4-21b98f8dd64c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:30.669047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f4a9509-0c1f-4905-b3f4-21b98f8dd64c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Mar 08 13:22:30.669578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 264/535] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:30.684470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-faf5520f-acf6-4069-bb5f-fa49653c70f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:30.685412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-faf5520f-acf6-4069-bb5f-fa49653c70f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:30.691610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faf5520f-acf6-4069-bb5f-fa49653c70f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.692053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faf5520f-acf6-4069-bb5f-fa49653c70f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:30.692858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faf5520f-acf6-4069-bb5f-fa49653c70f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.693278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faf5520f-acf6-4069-bb5f-fa49653c70f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:30.720644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-faf5520f-acf6-4069-bb5f-fa49653c70f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040064 Mar 08 13:22:30.721190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 272/536] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:30.982243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:30.982843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:30.988609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.989086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:30.989840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:30.990529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:31.121731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:31.134753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:31.136805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:31.137983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-44e3c17b-44e6-41ee-a864-f09fdebfb15f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159617 Mar 08 13:22:31.138774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 265/537] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:31.597505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:31.598117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:31.604240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:31.604623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:31.605411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:31.605843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:31.680289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5eb6501a-0ce8-4b5b-b502-26d8418b254e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:31.681233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5eb6501a-0ce8-4b5b-b502-26d8418b254e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:31.687501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb6501a-0ce8-4b5b-b502-26d8418b254e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:31.688073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb6501a-0ce8-4b5b-b502-26d8418b254e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:31.688880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb6501a-0ce8-4b5b-b502-26d8418b254e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:31.689520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb6501a-0ce8-4b5b-b502-26d8418b254e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:31.720041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5eb6501a-0ce8-4b5b-b502-26d8418b254e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Mar 08 13:22:31.720593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 266/538] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:31.732061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0fb37b61-189d-42a3-9ac0-d8afffdea1fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:31.733062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0fb37b61-189d-42a3-9ac0-d8afffdea1fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:31.738907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb37b61-189d-42a3-9ac0-d8afffdea1fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:31.739361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb37b61-189d-42a3-9ac0-d8afffdea1fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:31.740130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb37b61-189d-42a3-9ac0-d8afffdea1fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:31.741387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb37b61-189d-42a3-9ac0-d8afffdea1fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:31.748801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:31.755959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-df1a9dce-9a55-43e5-bf20-2f09cf14b605 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.162204 Mar 08 13:22:31.757235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 273/539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:31 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:31.772101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0fb37b61-189d-42a3-9ac0-d8afffdea1fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Mar 08 13:22:31.772748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 267/540] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:32.158219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:32.158741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:32.165418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.165861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.166709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.167173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.300769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:32.309309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:32.310833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:32.312002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-50b68e5a-4081-42b4-bc91-c477aef7a47e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157688 Mar 08 13:22:32.312559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 274/541] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:32 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:32.732061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-045de734-461c-4172-bf05-adab2326e0c1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:32.732995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-045de734-461c-4172-bf05-adab2326e0c1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:32.739215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-045de734-461c-4172-bf05-adab2326e0c1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.739665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-045de734-461c-4172-bf05-adab2326e0c1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.740696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-045de734-461c-4172-bf05-adab2326e0c1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.741726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-045de734-461c-4172-bf05-adab2326e0c1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.769351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-045de734-461c-4172-bf05-adab2326e0c1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041278 Mar 08 13:22:32.769896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 268/542] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:32.773111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:32.773716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:32.779589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.780037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.780832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.781264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.783429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dfb0f9f4-d156-4676-92ca-f2bcd0c4ef87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:32.784359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dfb0f9f4-d156-4676-92ca-f2bcd0c4ef87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:32.790752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0f9f4-d156-4676-92ca-f2bcd0c4ef87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.794625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0f9f4-d156-4676-92ca-f2bcd0c4ef87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.794625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0f9f4-d156-4676-92ca-f2bcd0c4ef87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:32.794625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb0f9f4-d156-4676-92ca-f2bcd0c4ef87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:32.820962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dfb0f9f4-d156-4676-92ca-f2bcd0c4ef87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041334 Mar 08 13:22:32.821537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 269/543] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:32.927184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:32.934959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b7dbc9f8-0ee3-4175-aa8f-06398789dabd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.165617 Mar 08 13:22:32.935502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 275/544] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:32 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:22:33.330234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:33.330843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:33.336757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.337218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:33.337978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.338413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:33.467448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:33.476087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:33.477556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:33.478706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eebe1043-e963-4f1f-8be0-30cae7249c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152361 Mar 08 13:22:33.479256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 270/545] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:33.781055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7523874d-c384-4523-a84f-fc05eff95ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:33.781888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7523874d-c384-4523-a84f-fc05eff95ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:33.788892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7523874d-c384-4523-a84f-fc05eff95ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.789346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7523874d-c384-4523-a84f-fc05eff95ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:33.790100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7523874d-c384-4523-a84f-fc05eff95ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.790534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7523874d-c384-4523-a84f-fc05eff95ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:33.817942 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7523874d-c384-4523-a84f-fc05eff95ccb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040912 Mar 08 13:22:33.818487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 276/546] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:33.831264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-49013714-a0df-4332-98b5-2255783bf3f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:33.835778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-49013714-a0df-4332-98b5-2255783bf3f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:33.841279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49013714-a0df-4332-98b5-2255783bf3f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.842275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49013714-a0df-4332-98b5-2255783bf3f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:33.843666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49013714-a0df-4332-98b5-2255783bf3f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.844540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49013714-a0df-4332-98b5-2255783bf3f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:33.875389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-49013714-a0df-4332-98b5-2255783bf3f6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047984 Mar 08 13:22:33.875977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 271/547] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:33.951364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:33.951984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:33.958896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.959357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:33.960716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:33.961164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:34.096051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:34.103612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aecd3dc6-34b5-4bc1-86da-6a48ac6ad6bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.156173 Mar 08 13:22:34.104176 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 277/548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:33 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:34.497093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:34.497697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:34.503463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:34.503911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:34.504683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:34.505123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:34.633273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:34.641460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:34.642981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:34.644123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d81acb37-23b3-4f4d-a93c-7061f591877c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.150933 Mar 08 13:22:34.644695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 272/549] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:34 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:34.829671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1a7bd0a5-fe76-4b64-98d7-8bf101cb4902 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:34.830606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1a7bd0a5-fe76-4b64-98d7-8bf101cb4902 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:34.837100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a7bd0a5-fe76-4b64-98d7-8bf101cb4902 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:34.837490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a7bd0a5-fe76-4b64-98d7-8bf101cb4902 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:34.838250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a7bd0a5-fe76-4b64-98d7-8bf101cb4902 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:34.838682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a7bd0a5-fe76-4b64-98d7-8bf101cb4902 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:34.868082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1a7bd0a5-fe76-4b64-98d7-8bf101cb4902 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042362 Mar 08 13:22:34.868627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 278/550] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:34.886300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0d88c53-027e-4d65-a1c9-bb96132d5b2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:34.887232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0d88c53-027e-4d65-a1c9-bb96132d5b2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:34.893518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0d88c53-027e-4d65-a1c9-bb96132d5b2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:34.893969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0d88c53-027e-4d65-a1c9-bb96132d5b2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:34.894736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0d88c53-027e-4d65-a1c9-bb96132d5b2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:34.895175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0d88c53-027e-4d65-a1c9-bb96132d5b2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:34.923148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0d88c53-027e-4d65-a1c9-bb96132d5b2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040794 Mar 08 13:22:34.923689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 273/551] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:35.121371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:35.121899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:35.127724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.128169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.128949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.129381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.265301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:35.273788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8a0972a9-92fb-4bbf-b4d9-5a8c3ba48be6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.156328 Mar 08 13:22:35.274354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 279/552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:35 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:35.663544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:35.664584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:35.670508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.670958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.671716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.672148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.808438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:35.816970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:35.818463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:35.820387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1426a3e1-93d2-42bb-ba42-e9d560f6786c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160938 Mar 08 13:22:35.820974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 274/553] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:35.879665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b75a02b-45a6-4365-97b1-9faf66ef1614 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:35.881276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b75a02b-45a6-4365-97b1-9faf66ef1614 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:35.889625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b75a02b-45a6-4365-97b1-9faf66ef1614 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.890313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b75a02b-45a6-4365-97b1-9faf66ef1614 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.892537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b75a02b-45a6-4365-97b1-9faf66ef1614 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.892537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b75a02b-45a6-4365-97b1-9faf66ef1614 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.920924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b75a02b-45a6-4365-97b1-9faf66ef1614 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Mar 08 13:22:35.921468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 280/554] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:35.935290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cf25df8a-221a-43cc-ba2d-cda949a5a37d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:35.936201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cf25df8a-221a-43cc-ba2d-cda949a5a37d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:35.942579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf25df8a-221a-43cc-ba2d-cda949a5a37d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.943032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf25df8a-221a-43cc-ba2d-cda949a5a37d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.943797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf25df8a-221a-43cc-ba2d-cda949a5a37d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:35.944826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf25df8a-221a-43cc-ba2d-cda949a5a37d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:35.973519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cf25df8a-221a-43cc-ba2d-cda949a5a37d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 Mar 08 13:22:35.974080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 275/555] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:36.246183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-787e4ba7-8e1c-4c60-98f4-37d811cd2ca5 req-afe503e6-f140-43bf-a860-c0542b35252f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4990fb-f02f-4297-a1c5-b1970d04c24c", "name": "network-vif-plugged", "status": "completed", "tag": "7958797c-844d-4a07-8ade-398ea8375499"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:22:36.254396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-787e4ba7-8e1c-4c60-98f4-37d811cd2ca5 req-afe503e6-f140-43bf-a860-c0542b35252f service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.254834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-787e4ba7-8e1c-4c60-98f4-37d811cd2ca5 req-afe503e6-f140-43bf-a860-c0542b35252f service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.266568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-787e4ba7-8e1c-4c60-98f4-37d811cd2ca5 req-afe503e6-f140-43bf-a860-c0542b35252f service nova] Creating event network-vif-plugged:7958797c-844d-4a07-8ade-398ea8375499 for instance 0d4990fb-f02f-4297-a1c5-b1970d04c24c on hv-cinder-83009 Mar 08 13:22:36.271694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-787e4ba7-8e1c-4c60-98f4-37d811cd2ca5 req-afe503e6-f140-43bf-a860-c0542b35252f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030941 Mar 08 13:22:36.272463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 281/556] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:36.290282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:36.290931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:36.297007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.297463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.298241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.298685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.439016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:36.446314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-22018dc6-bb4e-4209-a97c-03caaa975ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.160599 Mar 08 13:22:36.446872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 276/557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:36 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:36.839528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:36.840231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:36.846506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.846958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.847726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.848248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.932444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4b2096a5-1178-4530-8df5-21be2cfd3515 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:36.933396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4b2096a5-1178-4530-8df5-21be2cfd3515 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:36.939661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2096a5-1178-4530-8df5-21be2cfd3515 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.940222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2096a5-1178-4530-8df5-21be2cfd3515 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.940884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2096a5-1178-4530-8df5-21be2cfd3515 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.941316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2096a5-1178-4530-8df5-21be2cfd3515 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.970046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4b2096a5-1178-4530-8df5-21be2cfd3515 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041572 Mar 08 13:22:36.970615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 277/558] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:36.984045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0334728-ae14-4315-8b67-ce1a1b3060ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:36.984958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0334728-ae14-4315-8b67-ce1a1b3060ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:36.990692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0334728-ae14-4315-8b67-ce1a1b3060ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.991520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0334728-ae14-4315-8b67-ce1a1b3060ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:36.992292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0334728-ae14-4315-8b67-ce1a1b3060ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:36.992743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0334728-ae14-4315-8b67-ce1a1b3060ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:37.021617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0334728-ae14-4315-8b67-ce1a1b3060ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041204 Mar 08 13:22:37.022197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 278/559] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:37.044647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:37.052935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:37.054518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:37.055661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fd7dd338-d5f3-40b8-b1b5-4142c95105e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.221029 Mar 08 13:22:37.056221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 282/560] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:37.463044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:37.463648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:37.469529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:37.469973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:37.470808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:37.471335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:37.626313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:37.634334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1bc9d324-e6ce-49a8-8d89-4c31d02d27d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1266 microversion: 2.1 time: 0.175311 Mar 08 13:22:37.634901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 279/561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:37 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:37.981098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2704d497-3dde-4c43-bb74-2b6b482d1968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:37.982010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2704d497-3dde-4c43-bb74-2b6b482d1968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:37.988158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2704d497-3dde-4c43-bb74-2b6b482d1968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:37.988606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2704d497-3dde-4c43-bb74-2b6b482d1968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:37.990021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2704d497-3dde-4c43-bb74-2b6b482d1968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:37.990021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2704d497-3dde-4c43-bb74-2b6b482d1968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.018560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2704d497-3dde-4c43-bb74-2b6b482d1968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041435 Mar 08 13:22:38.019121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 283/562] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:38.033023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-51c5a250-04e0-4862-9a76-1783806edbc9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:38.033932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-51c5a250-04e0-4862-9a76-1783806edbc9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:38.040190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51c5a250-04e0-4862-9a76-1783806edbc9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.040638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51c5a250-04e0-4862-9a76-1783806edbc9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.041435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51c5a250-04e0-4862-9a76-1783806edbc9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.041870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51c5a250-04e0-4862-9a76-1783806edbc9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.070641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-51c5a250-04e0-4862-9a76-1783806edbc9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Mar 08 13:22:38.071244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 280/563] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:38.074181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:38.074829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:38.081122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.082880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.082880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.082880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.213977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:38.225012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:38.227508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:38.229492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8bd0575f-8481-4232-b6ca-383b92a4fc70 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159250 Mar 08 13:22:38.234000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 284/564] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:38 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:22:38.650886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:38.651487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:38.657339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.657781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.658532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.658960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.788968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:38.796195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cbe7a4fa-082f-4fa0-94a0-b61f2371f9e9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1452 microversion: 2.1 time: 0.149250 Mar 08 13:22:38.796773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 281/565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:38 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:38.813159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:38.813768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:38.819559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.820099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.820900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:38.821344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:38.961800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:38.969023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-572699f6-0328-45a4-bafc-80ce3d8571d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1452 microversion: 2.1 time: 0.159742 Mar 08 13:22:38.969579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 285/566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:22:38 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:22:39.030590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-76a28c34-684e-44b0-a71a-5024430d760c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:39.031530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-76a28c34-684e-44b0-a71a-5024430d760c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:39.037744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76a28c34-684e-44b0-a71a-5024430d760c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:39.038844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76a28c34-684e-44b0-a71a-5024430d760c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:39.039703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76a28c34-684e-44b0-a71a-5024430d760c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:39.040133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76a28c34-684e-44b0-a71a-5024430d760c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:39.067862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-76a28c34-684e-44b0-a71a-5024430d760c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041095 Mar 08 13:22:39.068439 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 282/567] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:39.082387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f1d55f31-c967-422f-a4ff-8897333083e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:39.083334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f1d55f31-c967-422f-a4ff-8897333083e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:39.090217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1d55f31-c967-422f-a4ff-8897333083e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:39.090664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1d55f31-c967-422f-a4ff-8897333083e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:39.091435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1d55f31-c967-422f-a4ff-8897333083e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:39.091867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1d55f31-c967-422f-a4ff-8897333083e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:39.123053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f1d55f31-c967-422f-a4ff-8897333083e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Mar 08 13:22:39.123635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 286/568] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:39.248479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:39.249030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:39.255121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:39.255572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:39.256349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:39.257326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:39.397102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:39.406349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:39.407913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:39.409099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-64f34558-f27f-42ab-9f0d-e368b5b4536f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.164654 Mar 08 13:22:39.409663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 283/569] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:40.079508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6c754eea-82f6-401e-828c-891b1951dbf2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:40.080413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6c754eea-82f6-401e-828c-891b1951dbf2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:40.086391 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c754eea-82f6-401e-828c-891b1951dbf2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:40.086967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c754eea-82f6-401e-828c-891b1951dbf2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:40.087580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c754eea-82f6-401e-828c-891b1951dbf2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:40.088012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c754eea-82f6-401e-828c-891b1951dbf2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:40.117878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6c754eea-82f6-401e-828c-891b1951dbf2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 Mar 08 13:22:40.118344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 287/570] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:40.135379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e97a42a8-c562-4d4b-a25d-e7529940f47d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:40.136282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e97a42a8-c562-4d4b-a25d-e7529940f47d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:40.142472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97a42a8-c562-4d4b-a25d-e7529940f47d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:40.142916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97a42a8-c562-4d4b-a25d-e7529940f47d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:40.143669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97a42a8-c562-4d4b-a25d-e7529940f47d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:40.144211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97a42a8-c562-4d4b-a25d-e7529940f47d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:40.172986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e97a42a8-c562-4d4b-a25d-e7529940f47d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041427 Mar 08 13:22:40.173556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 284/571] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:40.426713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:40.427320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:40.433340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:40.433789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:40.434556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:40.434991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:40.623063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:40.631323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:40.632917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:40.634079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-241ebfd8-b30f-4b92-a6b4-a3d9f75bc2c8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.211314 Mar 08 13:22:40.634642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 288/572] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:41.129565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e6538704-9962-44e9-9eb0-b5c332c2de71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:41.130472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e6538704-9962-44e9-9eb0-b5c332c2de71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:41.136343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e6538704-9962-44e9-9eb0-b5c332c2de71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:41.137008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e6538704-9962-44e9-9eb0-b5c332c2de71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:41.137599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e6538704-9962-44e9-9eb0-b5c332c2de71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:41.138045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e6538704-9962-44e9-9eb0-b5c332c2de71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:41.172184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e6538704-9962-44e9-9eb0-b5c332c2de71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Mar 08 13:22:41.172777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 285/573] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:41.185201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a535a608-f278-4a54-9063-6c12521a7168 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:41.186245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a535a608-f278-4a54-9063-6c12521a7168 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:41.193371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a535a608-f278-4a54-9063-6c12521a7168 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:41.193785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a535a608-f278-4a54-9063-6c12521a7168 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:41.194794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a535a608-f278-4a54-9063-6c12521a7168 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:41.195239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a535a608-f278-4a54-9063-6c12521a7168 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:41.226737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a535a608-f278-4a54-9063-6c12521a7168 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Mar 08 13:22:41.227314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 289/574] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:41.287970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-98fabb82-8733-40ab-be7b-0f99a9eb4abe req-31fa2721-9654-4e40-8b2f-129a31d480f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4990fb-f02f-4297-a1c5-b1970d04c24c", "tag": "7958797c-844d-4a07-8ade-398ea8375499"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:22:41.296063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-98fabb82-8733-40ab-be7b-0f99a9eb4abe req-31fa2721-9654-4e40-8b2f-129a31d480f8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:41.296501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-98fabb82-8733-40ab-be7b-0f99a9eb4abe req-31fa2721-9654-4e40-8b2f-129a31d480f8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:41.308024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-98fabb82-8733-40ab-be7b-0f99a9eb4abe req-31fa2721-9654-4e40-8b2f-129a31d480f8 service nova] Creating event network-changed:7958797c-844d-4a07-8ade-398ea8375499 for instance 0d4990fb-f02f-4297-a1c5-b1970d04c24c on hv-cinder-83009 Mar 08 13:22:41.313104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-98fabb82-8733-40ab-be7b-0f99a9eb4abe req-31fa2721-9654-4e40-8b2f-129a31d480f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028682 Mar 08 13:22:41.313696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 286/575] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:41.655480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:41.656682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:41.665152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:41.665602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:41.666971 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:41.667422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:41.916024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:41.924340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:41.926083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:41.927321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-41995018-d53b-40ce-bc9e-aff21cc50425 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.279112 Mar 08 13:22:41.928147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 290/576] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:42.184447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-59586010-1f1e-4c91-84b7-12329983c555 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:42.185572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-59586010-1f1e-4c91-84b7-12329983c555 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:42.191665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59586010-1f1e-4c91-84b7-12329983c555 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:42.192182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59586010-1f1e-4c91-84b7-12329983c555 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:42.193062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59586010-1f1e-4c91-84b7-12329983c555 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:42.193585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59586010-1f1e-4c91-84b7-12329983c555 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:42.225220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-59586010-1f1e-4c91-84b7-12329983c555 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Mar 08 13:22:42.229577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 287/577] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:42.237617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3d85bf0b-8b95-4734-8b2a-a22dc9269bad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:42.238530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3d85bf0b-8b95-4734-8b2a-a22dc9269bad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:42.245207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d85bf0b-8b95-4734-8b2a-a22dc9269bad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:42.245659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d85bf0b-8b95-4734-8b2a-a22dc9269bad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:42.246429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d85bf0b-8b95-4734-8b2a-a22dc9269bad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:42.246866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d85bf0b-8b95-4734-8b2a-a22dc9269bad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:42.275938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3d85bf0b-8b95-4734-8b2a-a22dc9269bad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042256 Mar 08 13:22:42.276493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 291/578] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:42.953059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:42.953669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:42.959541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:42.959995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:42.961131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:42.961581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:43.095262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:43.103462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:43.104986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:43.106138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-269b3ded-ac7a-434b-bca8-b7b16c3ef142 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156970 Mar 08 13:22:43.106694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 288/579] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:43.237579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5b990cdf-3fdc-4535-9ee5-a65274b4b3db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:43.238394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5b990cdf-3fdc-4535-9ee5-a65274b4b3db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:43.244857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b990cdf-3fdc-4535-9ee5-a65274b4b3db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:43.245305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b990cdf-3fdc-4535-9ee5-a65274b4b3db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:43.246067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b990cdf-3fdc-4535-9ee5-a65274b4b3db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:43.246522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b990cdf-3fdc-4535-9ee5-a65274b4b3db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:43.275357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5b990cdf-3fdc-4535-9ee5-a65274b4b3db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Mar 08 13:22:43.275906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 292/580] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:43.287294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-87351eaf-6763-4c0f-8b86-2cee25d74618 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:43.288199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-87351eaf-6763-4c0f-8b86-2cee25d74618 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:43.294573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87351eaf-6763-4c0f-8b86-2cee25d74618 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:43.295023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87351eaf-6763-4c0f-8b86-2cee25d74618 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:43.295785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87351eaf-6763-4c0f-8b86-2cee25d74618 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:43.296219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87351eaf-6763-4c0f-8b86-2cee25d74618 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:43.324979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-87351eaf-6763-4c0f-8b86-2cee25d74618 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041509 Mar 08 13:22:43.325542 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 289/581] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:44.124371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:44.125066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:44.131181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:44.131633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:44.132547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:44.133018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:44.266847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:44.275925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:44.277648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:44.278798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-79de57e9-44b2-483d-85c2-0d75bc0f0b53 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158413 Mar 08 13:22:44.279352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 293/582] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:44.286814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5b56a629-0a68-4317-8b55-2f300d6a96e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:44.287736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5b56a629-0a68-4317-8b55-2f300d6a96e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:44.294232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b56a629-0a68-4317-8b55-2f300d6a96e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:44.294671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b56a629-0a68-4317-8b55-2f300d6a96e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:44.295423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b56a629-0a68-4317-8b55-2f300d6a96e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:44.295852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b56a629-0a68-4317-8b55-2f300d6a96e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:44.323069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5b56a629-0a68-4317-8b55-2f300d6a96e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040193 Mar 08 13:22:44.323626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 290/583] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:44.337145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9185343e-6cb8-4f35-aed0-bc71cc2ccb0e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:44.338031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9185343e-6cb8-4f35-aed0-bc71cc2ccb0e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:44.343878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9185343e-6cb8-4f35-aed0-bc71cc2ccb0e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:44.344335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9185343e-6cb8-4f35-aed0-bc71cc2ccb0e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:44.345142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9185343e-6cb8-4f35-aed0-bc71cc2ccb0e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:44.345579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9185343e-6cb8-4f35-aed0-bc71cc2ccb0e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:44.374184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9185343e-6cb8-4f35-aed0-bc71cc2ccb0e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041769 Mar 08 13:22:44.374734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 294/584] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:45.297775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:45.298375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:45.304172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:45.304713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:45.305497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:45.305928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:45.334720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-25b5568b-fd2c-40fe-b2a8-4d7ce9195636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:45.336807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-25b5568b-fd2c-40fe-b2a8-4d7ce9195636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:45.343087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25b5568b-fd2c-40fe-b2a8-4d7ce9195636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:45.343539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25b5568b-fd2c-40fe-b2a8-4d7ce9195636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:45.346850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25b5568b-fd2c-40fe-b2a8-4d7ce9195636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:45.346850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25b5568b-fd2c-40fe-b2a8-4d7ce9195636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:45.373848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-25b5568b-fd2c-40fe-b2a8-4d7ce9195636 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Mar 08 13:22:45.374406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 295/585] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:45.386066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f540e744-2e31-43c8-99dc-552569a23862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:45.386904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f540e744-2e31-43c8-99dc-552569a23862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:45.392704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f540e744-2e31-43c8-99dc-552569a23862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:45.393159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f540e744-2e31-43c8-99dc-552569a23862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:45.393926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f540e744-2e31-43c8-99dc-552569a23862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:45.394360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f540e744-2e31-43c8-99dc-552569a23862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:45.423479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f540e744-2e31-43c8-99dc-552569a23862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 Mar 08 13:22:45.424047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 296/586] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:45.435362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:45.443469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:45.445549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:45.446832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-600ef34a-c49c-48ac-8971-d28fee498300 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153179 Mar 08 13:22:45.447385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 291/587] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:46.386544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ad40b7b9-ced1-44fa-af90-17eb25edabf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:46.387541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ad40b7b9-ced1-44fa-af90-17eb25edabf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:46.394283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad40b7b9-ced1-44fa-af90-17eb25edabf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:46.394776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad40b7b9-ced1-44fa-af90-17eb25edabf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:46.395603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad40b7b9-ced1-44fa-af90-17eb25edabf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:46.396087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad40b7b9-ced1-44fa-af90-17eb25edabf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:46.427323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ad40b7b9-ced1-44fa-af90-17eb25edabf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Mar 08 13:22:46.427944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 297/588] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:46.436144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-abe3d04d-19e7-4c03-abe0-6c031b100755 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:46.437119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-abe3d04d-19e7-4c03-abe0-6c031b100755 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:46.444178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-abe3d04d-19e7-4c03-abe0-6c031b100755 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:46.444724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-abe3d04d-19e7-4c03-abe0-6c031b100755 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:46.446417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-abe3d04d-19e7-4c03-abe0-6c031b100755 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:46.446905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-abe3d04d-19e7-4c03-abe0-6c031b100755 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:46.465053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:46.465657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:46.471610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:46.472258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:46.472850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:46.473296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:46.478602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-abe3d04d-19e7-4c03-abe0-6c031b100755 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Mar 08 13:22:46.482266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 292/589] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:46.612752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:46.621870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:46.623382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:46.624536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1791b95f-78e4-4adf-acef-6f05a411e8aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163466 Mar 08 13:22:46.625426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 298/590] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:22:47.439505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c671cb39-4636-48e2-9db1-fec6cec25290 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:47.440405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c671cb39-4636-48e2-9db1-fec6cec25290 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:47.446791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c671cb39-4636-48e2-9db1-fec6cec25290 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:47.447240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c671cb39-4636-48e2-9db1-fec6cec25290 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:47.447997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c671cb39-4636-48e2-9db1-fec6cec25290 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:47.448427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c671cb39-4636-48e2-9db1-fec6cec25290 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:47.475571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c671cb39-4636-48e2-9db1-fec6cec25290 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040126 Mar 08 13:22:47.476811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 293/591] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:47.489399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dc7b1935-45f7-485f-bceb-bf416c683607 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:47.490312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dc7b1935-45f7-485f-bceb-bf416c683607 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:47.496936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc7b1935-45f7-485f-bceb-bf416c683607 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:47.497383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc7b1935-45f7-485f-bceb-bf416c683607 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:47.498248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc7b1935-45f7-485f-bceb-bf416c683607 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:47.498683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc7b1935-45f7-485f-bceb-bf416c683607 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:47.527241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dc7b1935-45f7-485f-bceb-bf416c683607 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Mar 08 13:22:47.527811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 299/592] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:47.643256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:47.643894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:47.650583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:47.651032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:47.651798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:47.652236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:47.783740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:47.792290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:47.794632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:47.796109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a4cf3e2-799d-4f96-9757-6a3127490176 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156488 Mar 08 13:22:47.796681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 294/593] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:48.487499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-58856b9e-107c-498a-8d8c-25fffee1267b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:48.488444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-58856b9e-107c-498a-8d8c-25fffee1267b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:48.495852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58856b9e-107c-498a-8d8c-25fffee1267b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:48.496412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58856b9e-107c-498a-8d8c-25fffee1267b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:48.497138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58856b9e-107c-498a-8d8c-25fffee1267b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:48.497568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58856b9e-107c-498a-8d8c-25fffee1267b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:48.524888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-58856b9e-107c-498a-8d8c-25fffee1267b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041276 Mar 08 13:22:48.525359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 300/594] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:48.539979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e88534d5-cbed-4013-b56d-470a5b04d5d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:48.540916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e88534d5-cbed-4013-b56d-470a5b04d5d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:48.547259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e88534d5-cbed-4013-b56d-470a5b04d5d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:48.547736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e88534d5-cbed-4013-b56d-470a5b04d5d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:48.548493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e88534d5-cbed-4013-b56d-470a5b04d5d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:48.548972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e88534d5-cbed-4013-b56d-470a5b04d5d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:48.576953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e88534d5-cbed-4013-b56d-470a5b04d5d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 Mar 08 13:22:48.577497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 295/595] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:48.814416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:48.814936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:48.820803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:48.821252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:48.822005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:48.822440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:48.956746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:48.965497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:48.966988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:48.968127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9b02bd2c-1643-4461-a520-0322c7be6024 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157749 Mar 08 13:22:48.968757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 301/596] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:48 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:49.535440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0c43d32-c2ae-4417-8253-aea2d01a39ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:49.541391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0c43d32-c2ae-4417-8253-aea2d01a39ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:49.542158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0c43d32-c2ae-4417-8253-aea2d01a39ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:49.542609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0c43d32-c2ae-4417-8253-aea2d01a39ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:49.543373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0c43d32-c2ae-4417-8253-aea2d01a39ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:49.543814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0c43d32-c2ae-4417-8253-aea2d01a39ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:49.573204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0c43d32-c2ae-4417-8253-aea2d01a39ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 Mar 08 13:22:49.573758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 296/597] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:49.588093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8848fa6f-08b5-4b96-9026-d7ae37cae25e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:49.588988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8848fa6f-08b5-4b96-9026-d7ae37cae25e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:49.595409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8848fa6f-08b5-4b96-9026-d7ae37cae25e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:49.595860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8848fa6f-08b5-4b96-9026-d7ae37cae25e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:49.596627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8848fa6f-08b5-4b96-9026-d7ae37cae25e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:49.597096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8848fa6f-08b5-4b96-9026-d7ae37cae25e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:49.626025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8848fa6f-08b5-4b96-9026-d7ae37cae25e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Mar 08 13:22:49.626632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 302/598] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:49.987418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:49.988021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:49.994713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:49.995174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:49.995930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:49.996363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:50.133518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:50.141578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:50.143064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:50.144200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-476cb8a4-4330-4df2-9d4a-e949dfe85297 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160646 Mar 08 13:22:50.144777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 297/599] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:50.584853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a6fee07-980d-4f8c-9677-00fac7b95168 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:50.585927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6a6fee07-980d-4f8c-9677-00fac7b95168 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:50.591773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a6fee07-980d-4f8c-9677-00fac7b95168 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:50.592365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a6fee07-980d-4f8c-9677-00fac7b95168 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:50.593015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a6fee07-980d-4f8c-9677-00fac7b95168 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:50.593437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a6fee07-980d-4f8c-9677-00fac7b95168 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:50.622698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a6fee07-980d-4f8c-9677-00fac7b95168 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041858 Mar 08 13:22:50.623252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 303/600] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:50.639492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-07e7879f-86dd-4a73-8d87-a570fbe76a26 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:50.640893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-07e7879f-86dd-4a73-8d87-a570fbe76a26 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:50.650320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07e7879f-86dd-4a73-8d87-a570fbe76a26 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:50.650939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07e7879f-86dd-4a73-8d87-a570fbe76a26 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:50.652103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07e7879f-86dd-4a73-8d87-a570fbe76a26 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:50.652811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07e7879f-86dd-4a73-8d87-a570fbe76a26 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:50.683077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-07e7879f-86dd-4a73-8d87-a570fbe76a26 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049467 Mar 08 13:22:50.683617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 298/601] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:51.162901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:51.163447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:51.169726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:51.170163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:51.170918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:51.171409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:51.358552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:51.364388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:51.366078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:51.368078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-27b5cec4-95a9-4c60-972b-47f909e1d779 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.208163 Mar 08 13:22:51.368836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 304/602] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:51.635756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c46da9fa-ec51-4dd2-89eb-cd6aeb004c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:51.639446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c46da9fa-ec51-4dd2-89eb-cd6aeb004c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:51.646976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c46da9fa-ec51-4dd2-89eb-cd6aeb004c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:51.647642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c46da9fa-ec51-4dd2-89eb-cd6aeb004c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:51.649255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c46da9fa-ec51-4dd2-89eb-cd6aeb004c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:51.649768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c46da9fa-ec51-4dd2-89eb-cd6aeb004c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:51.678266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c46da9fa-ec51-4dd2-89eb-cd6aeb004c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Mar 08 13:22:51.678834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 299/603] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:51.694620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-625ebcb7-fa4c-4a64-a6dd-8d9c5784f7c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:51.696247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-625ebcb7-fa4c-4a64-a6dd-8d9c5784f7c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:51.702688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-625ebcb7-fa4c-4a64-a6dd-8d9c5784f7c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:51.703140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-625ebcb7-fa4c-4a64-a6dd-8d9c5784f7c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:51.703906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-625ebcb7-fa4c-4a64-a6dd-8d9c5784f7c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:51.704339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-625ebcb7-fa4c-4a64-a6dd-8d9c5784f7c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:51.732780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-625ebcb7-fa4c-4a64-a6dd-8d9c5784f7c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041989 Mar 08 13:22:51.733344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 305/604] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:52.387148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:52.387683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:52.393875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:52.394322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:52.395086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:52.395517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:52.534371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:52.542617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:52.544104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:52.545280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-997927a6-2e7d-4236-a3c0-e8d298513e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162789 Mar 08 13:22:52.545842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 300/605] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:52.690641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-75157405-6411-4938-8c6f-443354c42579 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:52.691556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-75157405-6411-4938-8c6f-443354c42579 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:52.698465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-75157405-6411-4938-8c6f-443354c42579 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:52.699035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-75157405-6411-4938-8c6f-443354c42579 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:52.699662 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-75157405-6411-4938-8c6f-443354c42579 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:52.702939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-75157405-6411-4938-8c6f-443354c42579 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:52.730017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-75157405-6411-4938-8c6f-443354c42579 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Mar 08 13:22:52.730571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 306/606] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:52.744112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8fe75937-d84e-4227-89ef-612ac2c44197 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:52.745044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8fe75937-d84e-4227-89ef-612ac2c44197 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:52.751282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8fe75937-d84e-4227-89ef-612ac2c44197 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:52.754690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8fe75937-d84e-4227-89ef-612ac2c44197 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:52.754690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8fe75937-d84e-4227-89ef-612ac2c44197 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:52.754690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8fe75937-d84e-4227-89ef-612ac2c44197 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:52.781436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8fe75937-d84e-4227-89ef-612ac2c44197 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Mar 08 13:22:52.783833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 301/607] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:53.564710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:53.565318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:53.572056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:53.572497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:53.573295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:53.573768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:53.723934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:53.732473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:53.734035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:53.735177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b341d198-61d1-4240-a30b-b8d0bc96c077 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.174677 Mar 08 13:22:53.735738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 307/608] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:53.741625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d577eda3-34bf-4a47-9319-f977863fc672 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:53.742970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d577eda3-34bf-4a47-9319-f977863fc672 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:53.749111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d577eda3-34bf-4a47-9319-f977863fc672 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:53.749981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d577eda3-34bf-4a47-9319-f977863fc672 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:53.750231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d577eda3-34bf-4a47-9319-f977863fc672 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:53.750656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d577eda3-34bf-4a47-9319-f977863fc672 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:53.779487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d577eda3-34bf-4a47-9319-f977863fc672 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041753 Mar 08 13:22:53.780036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 302/609] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:53.793223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-498c8c95-08bb-462c-92e6-79a593ef9c32 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:53.794139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-498c8c95-08bb-462c-92e6-79a593ef9c32 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:53.799960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498c8c95-08bb-462c-92e6-79a593ef9c32 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:53.800413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498c8c95-08bb-462c-92e6-79a593ef9c32 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:53.801217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498c8c95-08bb-462c-92e6-79a593ef9c32 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:53.801705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-498c8c95-08bb-462c-92e6-79a593ef9c32 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:53.829980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-498c8c95-08bb-462c-92e6-79a593ef9c32 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040681 Mar 08 13:22:53.830548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 308/610] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:54.759682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:54.760296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:54.766480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:54.771635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:54.771635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:54.771635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:54.792227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-41d29faf-d525-4cd6-9c2f-a5e30334b260 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:54.793232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-41d29faf-d525-4cd6-9c2f-a5e30334b260 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:54.799065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d29faf-d525-4cd6-9c2f-a5e30334b260 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:54.800349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d29faf-d525-4cd6-9c2f-a5e30334b260 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:54.800349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d29faf-d525-4cd6-9c2f-a5e30334b260 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:54.800934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-41d29faf-d525-4cd6-9c2f-a5e30334b260 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:54.830911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-41d29faf-d525-4cd6-9c2f-a5e30334b260 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Mar 08 13:22:54.831399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 309/611] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:54.842161 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-af21ce76-0e42-42ff-85af-da4def7e6b49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:54.843074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-af21ce76-0e42-42ff-85af-da4def7e6b49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:54.848852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af21ce76-0e42-42ff-85af-da4def7e6b49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:54.849311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af21ce76-0e42-42ff-85af-da4def7e6b49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:54.850422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af21ce76-0e42-42ff-85af-da4def7e6b49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:54.850553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af21ce76-0e42-42ff-85af-da4def7e6b49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:54.882118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-af21ce76-0e42-42ff-85af-da4def7e6b49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Mar 08 13:22:54.882711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 310/612] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:22:54.903130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:54.911493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:54.914822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:54.914988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fc3327d3-8e4d-4379-8812-3f4e64cc37cf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158812 Mar 08 13:22:54.915452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 303/613] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:55.842897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0c20bb2d-48dd-4539-a7b2-38d15ac1504b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:55.843865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0c20bb2d-48dd-4539-a7b2-38d15ac1504b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:55.850355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c20bb2d-48dd-4539-a7b2-38d15ac1504b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:55.850801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c20bb2d-48dd-4539-a7b2-38d15ac1504b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:55.852431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c20bb2d-48dd-4539-a7b2-38d15ac1504b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:55.852564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c20bb2d-48dd-4539-a7b2-38d15ac1504b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:55.887825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0c20bb2d-48dd-4539-a7b2-38d15ac1504b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048949 Mar 08 13:22:55.888575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 311/614] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:55.894075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3c47101d-9da9-4843-a1a3-6269e5f52b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:55.895022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3c47101d-9da9-4843-a1a3-6269e5f52b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:55.902298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c47101d-9da9-4843-a1a3-6269e5f52b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:55.902748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c47101d-9da9-4843-a1a3-6269e5f52b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:55.903524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c47101d-9da9-4843-a1a3-6269e5f52b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:55.903997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c47101d-9da9-4843-a1a3-6269e5f52b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:55.933910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:55.934142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3c47101d-9da9-4843-a1a3-6269e5f52b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Mar 08 13:22:55.934524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:55.934890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 304/615] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:55.940575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:55.941060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:55.941830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:55.942269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:56.072254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:56.080513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:56.082029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:56.083172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a819667b-4fe2-4bdc-9b46-026c0b420ff0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153735 Mar 08 13:22:56.083725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 312/616] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:56.900298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-14c67623-7d50-467c-b8b1-bf5f52c8fcc7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:56.901231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-14c67623-7d50-467c-b8b1-bf5f52c8fcc7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:56.907514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14c67623-7d50-467c-b8b1-bf5f52c8fcc7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:56.907960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14c67623-7d50-467c-b8b1-bf5f52c8fcc7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:56.908737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14c67623-7d50-467c-b8b1-bf5f52c8fcc7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:56.909173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14c67623-7d50-467c-b8b1-bf5f52c8fcc7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:56.936702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-14c67623-7d50-467c-b8b1-bf5f52c8fcc7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 Mar 08 13:22:56.937259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 305/617] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:56.945668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-09096918-13dd-412e-9c08-b3f0a3d6ef84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:56.946685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-09096918-13dd-412e-9c08-b3f0a3d6ef84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:56.952963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09096918-13dd-412e-9c08-b3f0a3d6ef84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:56.953416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09096918-13dd-412e-9c08-b3f0a3d6ef84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:56.954181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09096918-13dd-412e-9c08-b3f0a3d6ef84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:56.954616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09096918-13dd-412e-9c08-b3f0a3d6ef84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:56.983282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-09096918-13dd-412e-9c08-b3f0a3d6ef84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041593 Mar 08 13:22:56.983836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 313/618] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:57.100834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:57.101443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:57.107960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:57.108449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:57.109250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:57.109693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:57.237613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:57.246031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:57.247521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:57.248685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9b9416b8-8fa1-4d66-b0e7-0384ce365846 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151805 Mar 08 13:22:57.249240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 306/619] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:57.948256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-15fb7f8a-91d3-4b96-a25e-ed64aa19d9c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:57.949197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-15fb7f8a-91d3-4b96-a25e-ed64aa19d9c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:57.955468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15fb7f8a-91d3-4b96-a25e-ed64aa19d9c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:57.955917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15fb7f8a-91d3-4b96-a25e-ed64aa19d9c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:57.956754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15fb7f8a-91d3-4b96-a25e-ed64aa19d9c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:57.957131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15fb7f8a-91d3-4b96-a25e-ed64aa19d9c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:57.984364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-15fb7f8a-91d3-4b96-a25e-ed64aa19d9c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040788 Mar 08 13:22:57.984941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 314/620] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:57.994720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-51075b13-a540-4bd7-bad8-de2d5e2d2dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:57.995635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-51075b13-a540-4bd7-bad8-de2d5e2d2dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:58.001864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51075b13-a540-4bd7-bad8-de2d5e2d2dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:58.002319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51075b13-a540-4bd7-bad8-de2d5e2d2dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:58.003084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51075b13-a540-4bd7-bad8-de2d5e2d2dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:58.003523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51075b13-a540-4bd7-bad8-de2d5e2d2dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:58.032725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-51075b13-a540-4bd7-bad8-de2d5e2d2dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042882 Mar 08 13:22:58.033275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 307/621] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:58.267249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:58.267886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:58.273845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:58.274348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:58.275110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:58.275544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:58.407190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:58.416158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:58.417879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:58.419035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-80d58aff-b370-4fdd-98c0-aa896efac0d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155784 Mar 08 13:22:58.419579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 315/622] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:22:58.995813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-10cc4819-1606-4f9b-b843-0c6358b0daff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:58.996739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-10cc4819-1606-4f9b-b843-0c6358b0daff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:59.003138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10cc4819-1606-4f9b-b843-0c6358b0daff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:59.003524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10cc4819-1606-4f9b-b843-0c6358b0daff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:59.004439 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10cc4819-1606-4f9b-b843-0c6358b0daff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:59.004908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10cc4819-1606-4f9b-b843-0c6358b0daff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:59.032981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-10cc4819-1606-4f9b-b843-0c6358b0daff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041429 Mar 08 13:22:59.033521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 308/623] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:59.043321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f26c6fef-70c7-4915-b9ed-eb8bd6c4d74e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:59.044259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f26c6fef-70c7-4915-b9ed-eb8bd6c4d74e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:59.050507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f26c6fef-70c7-4915-b9ed-eb8bd6c4d74e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:59.050954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f26c6fef-70c7-4915-b9ed-eb8bd6c4d74e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:59.051706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f26c6fef-70c7-4915-b9ed-eb8bd6c4d74e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:59.052136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f26c6fef-70c7-4915-b9ed-eb8bd6c4d74e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:59.079846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f26c6fef-70c7-4915-b9ed-eb8bd6c4d74e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040454 Mar 08 13:22:59.080374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 316/624] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:22:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:22:59.436895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:22:59.437508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:22:59.443241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:59.443747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:59.444448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:22:59.444945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:22:59.584009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:59.592488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:59.594146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:22:59.595303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1fbec812-4b1e-4383-b8aa-31f86a466713 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162306 Mar 08 13:22:59.595859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 309/625] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:22:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:00.045279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-981b4ea7-8823-49d0-9778-4af9ad6c9f41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:00.046193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-981b4ea7-8823-49d0-9778-4af9ad6c9f41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:00.052564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-981b4ea7-8823-49d0-9778-4af9ad6c9f41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:00.052998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-981b4ea7-8823-49d0-9778-4af9ad6c9f41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:00.053794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-981b4ea7-8823-49d0-9778-4af9ad6c9f41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:00.054259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-981b4ea7-8823-49d0-9778-4af9ad6c9f41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:00.081953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-981b4ea7-8823-49d0-9778-4af9ad6c9f41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040648 Mar 08 13:23:00.082529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 317/626] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:00.091827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-256e7358-4c05-41c3-bfa8-3ec025b2198a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:00.092783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-256e7358-4c05-41c3-bfa8-3ec025b2198a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:00.098896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-256e7358-4c05-41c3-bfa8-3ec025b2198a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:00.099341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-256e7358-4c05-41c3-bfa8-3ec025b2198a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:00.100096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-256e7358-4c05-41c3-bfa8-3ec025b2198a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:00.100530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-256e7358-4c05-41c3-bfa8-3ec025b2198a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:00.128397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-256e7358-4c05-41c3-bfa8-3ec025b2198a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 Mar 08 13:23:00.128977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 310/627] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:00.613601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:00.614093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:00.620439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:00.620919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:00.621671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:00.622099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:00.759206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:00.767442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:00.768970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:00.770112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b2fd0501-d76f-4b22-bc97-ab4a80c38537 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160505 Mar 08 13:23:00.770658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 318/628] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:00 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:01.093678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7a03af94-eeb2-4432-9b03-a958f93591bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:01.094579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7a03af94-eeb2-4432-9b03-a958f93591bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:01.100722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a03af94-eeb2-4432-9b03-a958f93591bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:01.101263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a03af94-eeb2-4432-9b03-a958f93591bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:01.102051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a03af94-eeb2-4432-9b03-a958f93591bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:01.102632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a03af94-eeb2-4432-9b03-a958f93591bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:01.130106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7a03af94-eeb2-4432-9b03-a958f93591bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040338 Mar 08 13:23:01.130573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 311/629] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:01.139826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4cdda78e-b3b7-4bcf-9e0e-6cfb5eee2c90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:01.140766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4cdda78e-b3b7-4bcf-9e0e-6cfb5eee2c90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:01.147034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cdda78e-b3b7-4bcf-9e0e-6cfb5eee2c90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:01.147486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cdda78e-b3b7-4bcf-9e0e-6cfb5eee2c90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:01.148276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cdda78e-b3b7-4bcf-9e0e-6cfb5eee2c90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:01.148745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cdda78e-b3b7-4bcf-9e0e-6cfb5eee2c90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:01.176719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4cdda78e-b3b7-4bcf-9e0e-6cfb5eee2c90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040796 Mar 08 13:23:01.177262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 319/630] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:01.789059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:01.790187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:01.796041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:01.796485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:01.797264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:01.797697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:01.940780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:01.949248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:01.950755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:01.951932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cc116117-17b3-4aab-aaa3-3fd2686a75e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.166790 Mar 08 13:23:01.952493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 312/631] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:02.142861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e4ba8d3f-b6c4-4bd9-8a1b-1b0408515314 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:02.143697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e4ba8d3f-b6c4-4bd9-8a1b-1b0408515314 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:02.149601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4ba8d3f-b6c4-4bd9-8a1b-1b0408515314 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:02.150051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4ba8d3f-b6c4-4bd9-8a1b-1b0408515314 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:02.150944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4ba8d3f-b6c4-4bd9-8a1b-1b0408515314 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:02.151415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4ba8d3f-b6c4-4bd9-8a1b-1b0408515314 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:02.178562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e4ba8d3f-b6c4-4bd9-8a1b-1b0408515314 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039968 Mar 08 13:23:02.179114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 320/632] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:02.187976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0cdee2d-b5e1-4107-b708-8ad203f508b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:02.189136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0cdee2d-b5e1-4107-b708-8ad203f508b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:02.195413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0cdee2d-b5e1-4107-b708-8ad203f508b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:02.195864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0cdee2d-b5e1-4107-b708-8ad203f508b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:02.196619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0cdee2d-b5e1-4107-b708-8ad203f508b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:02.197084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0cdee2d-b5e1-4107-b708-8ad203f508b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:02.225573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0cdee2d-b5e1-4107-b708-8ad203f508b0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041477 Mar 08 13:23:02.226203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 313/633] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:02.970322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:02.971014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:02.976595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:02.977079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:02.977839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:02.978270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:03.106729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:03.114856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:03.116355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:03.117524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eb2bdf83-7cb0-41e6-9a57-ce8dbdb54030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151079 Mar 08 13:23:03.118343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 321/634] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:03.190563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7aa9fa31-42d6-4a4e-81c0-b16d463cfbb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:03.191458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7aa9fa31-42d6-4a4e-81c0-b16d463cfbb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:03.197636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa31-42d6-4a4e-81c0-b16d463cfbb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:03.198169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa31-42d6-4a4e-81c0-b16d463cfbb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:03.198929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa31-42d6-4a4e-81c0-b16d463cfbb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:03.199364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7aa9fa31-42d6-4a4e-81c0-b16d463cfbb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:03.227068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7aa9fa31-42d6-4a4e-81c0-b16d463cfbb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040462 Mar 08 13:23:03.227541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 314/635] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:03.237278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2fc6e2f1-0620-4c61-b150-c87a9f7cc550 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:03.238207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2fc6e2f1-0620-4c61-b150-c87a9f7cc550 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:03.244619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fc6e2f1-0620-4c61-b150-c87a9f7cc550 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:03.245111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fc6e2f1-0620-4c61-b150-c87a9f7cc550 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:03.245866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fc6e2f1-0620-4c61-b150-c87a9f7cc550 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:03.246294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fc6e2f1-0620-4c61-b150-c87a9f7cc550 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:03.274517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2fc6e2f1-0620-4c61-b150-c87a9f7cc550 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041121 Mar 08 13:23:03.275052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 322/636] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:04.136041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:04.136641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:04.142623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:04.143097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:04.143845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:04.144307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:04.239402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eaf08e70-d8b0-45e8-be27-eb3411705dba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:04.240312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eaf08e70-d8b0-45e8-be27-eb3411705dba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:04.247336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eaf08e70-d8b0-45e8-be27-eb3411705dba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:04.247793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eaf08e70-d8b0-45e8-be27-eb3411705dba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:04.248563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eaf08e70-d8b0-45e8-be27-eb3411705dba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:04.249018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eaf08e70-d8b0-45e8-be27-eb3411705dba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:04.276950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eaf08e70-d8b0-45e8-be27-eb3411705dba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041467 Mar 08 13:23:04.277523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 323/637] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:04.277977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:04.285994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-09d210ec-fe6e-483b-8ad9-515e3804e195 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:04.286883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-09d210ec-fe6e-483b-8ad9-515e3804e195 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:04.287055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:04.288561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:04.289749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-65abc036-7d44-4c15-bd71-eef12c689837 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157708 Mar 08 13:23:04.290300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 315/638] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:04.293202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09d210ec-fe6e-483b-8ad9-515e3804e195 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:04.293646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09d210ec-fe6e-483b-8ad9-515e3804e195 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:04.294404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09d210ec-fe6e-483b-8ad9-515e3804e195 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:04.294839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09d210ec-fe6e-483b-8ad9-515e3804e195 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:04.322520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-09d210ec-fe6e-483b-8ad9-515e3804e195 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040117 Mar 08 13:23:04.323101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 324/639] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:05.288107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6ad10f8e-1506-4080-9946-9c860c957a09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:05.289039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6ad10f8e-1506-4080-9946-9c860c957a09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:05.296731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ad10f8e-1506-4080-9946-9c860c957a09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:05.297189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ad10f8e-1506-4080-9946-9c860c957a09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:05.297959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ad10f8e-1506-4080-9946-9c860c957a09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:05.298394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6ad10f8e-1506-4080-9946-9c860c957a09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:05.312104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:05.312750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:05.319070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:05.319974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:05.320284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:05.320776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:05.334539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6ad10f8e-1506-4080-9946-9c860c957a09 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049910 Mar 08 13:23:05.334539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 316/640] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:05.339739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-79efc0ac-16fe-46c8-ba32-c45d2b45a577 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:05.340979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79efc0ac-16fe-46c8-ba32-c45d2b45a577 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:05.350321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79efc0ac-16fe-46c8-ba32-c45d2b45a577 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:05.350321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79efc0ac-16fe-46c8-ba32-c45d2b45a577 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:05.350321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79efc0ac-16fe-46c8-ba32-c45d2b45a577 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:05.350321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79efc0ac-16fe-46c8-ba32-c45d2b45a577 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:05.382793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-79efc0ac-16fe-46c8-ba32-c45d2b45a577 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047181 Mar 08 13:23:05.383429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 317/641] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:05.470979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:05.481058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:05.482583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:05.483748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a4467228-07dc-4b23-9737-5ed757625d60 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.178424 Mar 08 13:23:05.484304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 325/642] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:06.345081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d17ab1b3-003c-4e3c-a214-56d11ae33ffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:06.345983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d17ab1b3-003c-4e3c-a214-56d11ae33ffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:06.352287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d17ab1b3-003c-4e3c-a214-56d11ae33ffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:06.352768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d17ab1b3-003c-4e3c-a214-56d11ae33ffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:06.353564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d17ab1b3-003c-4e3c-a214-56d11ae33ffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:06.354160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d17ab1b3-003c-4e3c-a214-56d11ae33ffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:06.382770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d17ab1b3-003c-4e3c-a214-56d11ae33ffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Mar 08 13:23:06.383263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 318/643] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:06.394828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3301e83b-052a-40e9-b451-7922f14d1208 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:06.395770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3301e83b-052a-40e9-b451-7922f14d1208 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:06.403149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3301e83b-052a-40e9-b451-7922f14d1208 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:06.403597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3301e83b-052a-40e9-b451-7922f14d1208 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:06.404363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3301e83b-052a-40e9-b451-7922f14d1208 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:06.404848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3301e83b-052a-40e9-b451-7922f14d1208 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:06.432406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3301e83b-052a-40e9-b451-7922f14d1208 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Mar 08 13:23:06.432985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 326/644] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:06.502533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:06.503168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:06.509020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:06.509480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:06.510778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:06.511305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:06.639738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:06.647868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:06.649391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:06.650526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b950fb94-0620-42e0-9acc-29f3ba3c174e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151954 Mar 08 13:23:06.651348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 319/645] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:07.395082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-112cc15d-982b-4014-89b8-2d6dff5f3d58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:07.395979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-112cc15d-982b-4014-89b8-2d6dff5f3d58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:07.402125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-112cc15d-982b-4014-89b8-2d6dff5f3d58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:07.402565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-112cc15d-982b-4014-89b8-2d6dff5f3d58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:07.403317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-112cc15d-982b-4014-89b8-2d6dff5f3d58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:07.403748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-112cc15d-982b-4014-89b8-2d6dff5f3d58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:07.430919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-112cc15d-982b-4014-89b8-2d6dff5f3d58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039752 Mar 08 13:23:07.431451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 327/646] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:07.443262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0438c858-7092-44b3-9fd8-bed3f73c0743 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:07.444254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0438c858-7092-44b3-9fd8-bed3f73c0743 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:07.451403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0438c858-7092-44b3-9fd8-bed3f73c0743 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:07.451853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0438c858-7092-44b3-9fd8-bed3f73c0743 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:07.452639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0438c858-7092-44b3-9fd8-bed3f73c0743 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:07.453121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0438c858-7092-44b3-9fd8-bed3f73c0743 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:07.480859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0438c858-7092-44b3-9fd8-bed3f73c0743 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Mar 08 13:23:07.481419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 320/647] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:07.668813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:07.669445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:07.675262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:07.675704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:07.676454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:07.676907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:07.806251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:07.815421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:07.817037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:07.818190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-68eb75cb-7a07-49c3-84dd-ff44332092e2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153266 Mar 08 13:23:07.818755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 328/648] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:07 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:08.442966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-55d31bf7-1d9c-4574-982b-30c9ceed4233 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:08.443869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-55d31bf7-1d9c-4574-982b-30c9ceed4233 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:08.450509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55d31bf7-1d9c-4574-982b-30c9ceed4233 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:08.450961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55d31bf7-1d9c-4574-982b-30c9ceed4233 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:08.451730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55d31bf7-1d9c-4574-982b-30c9ceed4233 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:08.452194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55d31bf7-1d9c-4574-982b-30c9ceed4233 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:08.479629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-55d31bf7-1d9c-4574-982b-30c9ceed4233 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040761 Mar 08 13:23:08.480733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 321/649] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:08.491294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c27b2aae-4df6-4e96-8e95-96d5897a6a96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:08.492241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c27b2aae-4df6-4e96-8e95-96d5897a6a96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:08.499698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27b2aae-4df6-4e96-8e95-96d5897a6a96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:08.500142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27b2aae-4df6-4e96-8e95-96d5897a6a96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:08.501025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27b2aae-4df6-4e96-8e95-96d5897a6a96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:08.501460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27b2aae-4df6-4e96-8e95-96d5897a6a96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:08.528606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c27b2aae-4df6-4e96-8e95-96d5897a6a96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041246 Mar 08 13:23:08.529183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 329/650] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:08.836510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:08.840416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:08.843531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:08.843969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:08.844746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:08.845212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:08.978253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:08.989423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:08.991835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:08.993913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f82108ad-1ebc-4c36-8e0f-2e84bebaf235 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160872 Mar 08 13:23:08.994732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 322/651] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:09.491946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4dd6c69c-2c41-4ec9-858e-0d1c47fa4f16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:09.492804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4dd6c69c-2c41-4ec9-858e-0d1c47fa4f16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:09.499762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd6c69c-2c41-4ec9-858e-0d1c47fa4f16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:09.500214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd6c69c-2c41-4ec9-858e-0d1c47fa4f16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:09.501005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd6c69c-2c41-4ec9-858e-0d1c47fa4f16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:09.501444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dd6c69c-2c41-4ec9-858e-0d1c47fa4f16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:09.530810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4dd6c69c-2c41-4ec9-858e-0d1c47fa4f16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Mar 08 13:23:09.531343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 330/652] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:09.539261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9acca0db-f7e6-42be-8f19-82d2e6822575 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:09.540164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9acca0db-f7e6-42be-8f19-82d2e6822575 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:09.546560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9acca0db-f7e6-42be-8f19-82d2e6822575 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:09.547029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9acca0db-f7e6-42be-8f19-82d2e6822575 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:09.547785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9acca0db-f7e6-42be-8f19-82d2e6822575 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:09.548215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9acca0db-f7e6-42be-8f19-82d2e6822575 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:09.576004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9acca0db-f7e6-42be-8f19-82d2e6822575 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040634 Mar 08 13:23:09.577250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 323/653] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:10.016074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:10.016693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:10.022526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:10.022969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:10.023720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:10.024152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:10.156645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:10.164894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:10.166387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:10.167523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9cf56dc8-04a0-410b-adf9-5550eff22470 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155324 Mar 08 13:23:10.168076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 331/654] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:10 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:10.542257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77df5abb-e599-4e00-8d10-45980c9360a2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:10.543160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77df5abb-e599-4e00-8d10-45980c9360a2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:10.550300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77df5abb-e599-4e00-8d10-45980c9360a2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:10.550746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77df5abb-e599-4e00-8d10-45980c9360a2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:10.551509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77df5abb-e599-4e00-8d10-45980c9360a2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:10.551952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77df5abb-e599-4e00-8d10-45980c9360a2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:10.579765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77df5abb-e599-4e00-8d10-45980c9360a2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Mar 08 13:23:10.580311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 324/655] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:10.587367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dd7fde96-826b-458c-8c43-af9eea00a72b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:10.588273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dd7fde96-826b-458c-8c43-af9eea00a72b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:10.595061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd7fde96-826b-458c-8c43-af9eea00a72b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:10.595502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd7fde96-826b-458c-8c43-af9eea00a72b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:10.596263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd7fde96-826b-458c-8c43-af9eea00a72b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:10.596721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd7fde96-826b-458c-8c43-af9eea00a72b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:10.624731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dd7fde96-826b-458c-8c43-af9eea00a72b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041199 Mar 08 13:23:10.625263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 332/656] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:11.186535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:11.187342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:11.193314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:11.193769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:11.194540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:11.194974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:11.324968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:11.333192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:11.334706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:11.335840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bfa27ae9-eefa-4020-b7c5-18d8e78d7a32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153197 Mar 08 13:23:11.336392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 325/657] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:11.592052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4af61be0-4b4c-463a-9000-bb6d352e1ad5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:11.593012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4af61be0-4b4c-463a-9000-bb6d352e1ad5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:11.599190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af61be0-4b4c-463a-9000-bb6d352e1ad5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:11.599639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af61be0-4b4c-463a-9000-bb6d352e1ad5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:11.600409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af61be0-4b4c-463a-9000-bb6d352e1ad5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:11.600880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af61be0-4b4c-463a-9000-bb6d352e1ad5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:11.630875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4af61be0-4b4c-463a-9000-bb6d352e1ad5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Mar 08 13:23:11.631429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 333/658] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:11.635279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ce0c9dd0-e287-46ae-8c52-5d31dd9fb9b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:11.636247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ce0c9dd0-e287-46ae-8c52-5d31dd9fb9b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:11.643470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce0c9dd0-e287-46ae-8c52-5d31dd9fb9b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:11.644219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce0c9dd0-e287-46ae-8c52-5d31dd9fb9b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:11.645235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce0c9dd0-e287-46ae-8c52-5d31dd9fb9b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:11.645673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ce0c9dd0-e287-46ae-8c52-5d31dd9fb9b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:11.673904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ce0c9dd0-e287-46ae-8c52-5d31dd9fb9b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Mar 08 13:23:11.674453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 326/659] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:12.354899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:12.355510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:12.361601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:12.362053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:12.362820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:12.363254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:12.500122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:12.508273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:12.509815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:12.510964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d927cfed-2293-4f62-a8e8-38ce59fb6dc9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159988 Mar 08 13:23:12.511521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 334/660] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:23:12.642686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-56f38c4a-a5e6-4774-84dd-10e2ed5a3e58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:12.643593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-56f38c4a-a5e6-4774-84dd-10e2ed5a3e58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:12.649737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56f38c4a-a5e6-4774-84dd-10e2ed5a3e58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:12.650187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56f38c4a-a5e6-4774-84dd-10e2ed5a3e58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:12.651066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56f38c4a-a5e6-4774-84dd-10e2ed5a3e58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:12.651472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56f38c4a-a5e6-4774-84dd-10e2ed5a3e58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:12.679270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-56f38c4a-a5e6-4774-84dd-10e2ed5a3e58 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041186 Mar 08 13:23:12.680013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 327/661] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:12.686035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-82556d55-d1b4-4c33-86a0-df6a33060110 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:12.687508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-82556d55-d1b4-4c33-86a0-df6a33060110 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:12.693905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82556d55-d1b4-4c33-86a0-df6a33060110 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:12.697138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82556d55-d1b4-4c33-86a0-df6a33060110 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:12.697138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82556d55-d1b4-4c33-86a0-df6a33060110 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:12.697138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82556d55-d1b4-4c33-86a0-df6a33060110 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:12.726493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-82556d55-d1b4-4c33-86a0-df6a33060110 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Mar 08 13:23:12.726977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 335/662] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:13.529651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:13.530194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:13.535969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:13.536415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:13.537200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:13.537638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:13.666329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:13.675131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:13.676642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:13.677821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e039dd21-4cb8-42bf-a669-b4b3a103f931 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152107 Mar 08 13:23:13.678384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 328/663] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:13.690744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c843e839-6e96-4da9-a136-f1007b189fe8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:13.691314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c843e839-6e96-4da9-a136-f1007b189fe8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:13.697637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c843e839-6e96-4da9-a136-f1007b189fe8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:13.698085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c843e839-6e96-4da9-a136-f1007b189fe8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:13.698860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c843e839-6e96-4da9-a136-f1007b189fe8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:13.699268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c843e839-6e96-4da9-a136-f1007b189fe8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:13.728797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c843e839-6e96-4da9-a136-f1007b189fe8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042893 Mar 08 13:23:13.729344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 336/664] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:13.739086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-73a83ed6-3713-4b59-95cf-5b4a5f989a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:13.740051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-73a83ed6-3713-4b59-95cf-5b4a5f989a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:13.746137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a83ed6-3713-4b59-95cf-5b4a5f989a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:13.746614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a83ed6-3713-4b59-95cf-5b4a5f989a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:13.747350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a83ed6-3713-4b59-95cf-5b4a5f989a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:13.747789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a83ed6-3713-4b59-95cf-5b4a5f989a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:13.777994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-73a83ed6-3713-4b59-95cf-5b4a5f989a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043876 Mar 08 13:23:13.778586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 329/665] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:14.698085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:14.698752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:14.705624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:14.706087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:14.706859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:14.707299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:14.740311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58a5b137-9707-4980-bcd4-fd7aa3ea3160 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:14.741581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58a5b137-9707-4980-bcd4-fd7aa3ea3160 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:14.748335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58a5b137-9707-4980-bcd4-fd7aa3ea3160 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:14.748820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58a5b137-9707-4980-bcd4-fd7aa3ea3160 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:14.749589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58a5b137-9707-4980-bcd4-fd7aa3ea3160 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:14.750678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58a5b137-9707-4980-bcd4-fd7aa3ea3160 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:14.780223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58a5b137-9707-4980-bcd4-fd7aa3ea3160 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Mar 08 13:23:14.780801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 330/666] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:14.789575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-46fd1ae6-7343-4b21-a539-9b2ca374de8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:14.790555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-46fd1ae6-7343-4b21-a539-9b2ca374de8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:14.796502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46fd1ae6-7343-4b21-a539-9b2ca374de8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:14.797048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46fd1ae6-7343-4b21-a539-9b2ca374de8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:14.797864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46fd1ae6-7343-4b21-a539-9b2ca374de8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:14.798290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46fd1ae6-7343-4b21-a539-9b2ca374de8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:14.826961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-46fd1ae6-7343-4b21-a539-9b2ca374de8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041188 Mar 08 13:23:14.827519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 331/667] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:14.844650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:14.853003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:14.854568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:14.855716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0fdd1a80-0551-42e9-a2ec-7a2f2d60e23a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.161521 Mar 08 13:23:14.856275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 337/668] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:14 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:15.791935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5c7fb8cb-3165-47c4-83f8-36f075effa65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:15.792937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5c7fb8cb-3165-47c4-83f8-36f075effa65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:15.800141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c7fb8cb-3165-47c4-83f8-36f075effa65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:15.800591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c7fb8cb-3165-47c4-83f8-36f075effa65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:15.801387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c7fb8cb-3165-47c4-83f8-36f075effa65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:15.801824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c7fb8cb-3165-47c4-83f8-36f075effa65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:15.830230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5c7fb8cb-3165-47c4-83f8-36f075effa65 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042208 Mar 08 13:23:15.835248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 332/669] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:15.839152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e25a697a-3ab7-466a-a185-634a54189fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:15.840070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e25a697a-3ab7-466a-a185-634a54189fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:15.846981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e25a697a-3ab7-466a-a185-634a54189fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:15.847429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e25a697a-3ab7-466a-a185-634a54189fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:15.848194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e25a697a-3ab7-466a-a185-634a54189fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:15.848629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e25a697a-3ab7-466a-a185-634a54189fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:15.875875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:15.876721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:15.881120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e25a697a-3ab7-466a-a185-634a54189fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Mar 08 13:23:15.881120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 338/670] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:15.883334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:15.883811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:15.884703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:15.885147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:16.019019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:16.027175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:16.028698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:16.029837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f24eff8c-8a61-472b-83bf-73a7931e69e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158132 Mar 08 13:23:16.030433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 333/671] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:16.845192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-648c0573-d9a9-431c-98c4-a983b0d5ac93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:16.846104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-648c0573-d9a9-431c-98c4-a983b0d5ac93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:16.852338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-648c0573-d9a9-431c-98c4-a983b0d5ac93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:16.852835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-648c0573-d9a9-431c-98c4-a983b0d5ac93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:16.853596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-648c0573-d9a9-431c-98c4-a983b0d5ac93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:16.854029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-648c0573-d9a9-431c-98c4-a983b0d5ac93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:16.883142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-648c0573-d9a9-431c-98c4-a983b0d5ac93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042001 Mar 08 13:23:16.883693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 339/672] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:16.890525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7de22a4b-759c-4185-bb88-e5c94d0cc4d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:16.891566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7de22a4b-759c-4185-bb88-e5c94d0cc4d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:16.897783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7de22a4b-759c-4185-bb88-e5c94d0cc4d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:16.898231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7de22a4b-759c-4185-bb88-e5c94d0cc4d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:16.898986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7de22a4b-759c-4185-bb88-e5c94d0cc4d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:16.899415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7de22a4b-759c-4185-bb88-e5c94d0cc4d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:16.927290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7de22a4b-759c-4185-bb88-e5c94d0cc4d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040623 Mar 08 13:23:16.927822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 334/673] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:17.049763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:17.050366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:17.056259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:17.056737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:17.057493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:17.057926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:17.191071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:17.199359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:17.200899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:17.202050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3cc66bdd-42a8-4f06-ab3b-d2c6f1414030 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157167 Mar 08 13:23:17.202609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 340/674] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:17.894940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-607deb6f-85c9-43fc-a8a6-d654a229f79c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:17.895843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-607deb6f-85c9-43fc-a8a6-d654a229f79c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:17.902050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-607deb6f-85c9-43fc-a8a6-d654a229f79c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:17.902493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-607deb6f-85c9-43fc-a8a6-d654a229f79c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:17.903248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-607deb6f-85c9-43fc-a8a6-d654a229f79c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:17.903679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-607deb6f-85c9-43fc-a8a6-d654a229f79c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:17.930968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-607deb6f-85c9-43fc-a8a6-d654a229f79c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040879 Mar 08 13:23:17.931503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 335/675] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:17.938556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-132906d7-da23-4e2d-ade8-a244dc3bdbbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:17.940164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-132906d7-da23-4e2d-ade8-a244dc3bdbbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:17.946421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-132906d7-da23-4e2d-ade8-a244dc3bdbbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:17.946871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-132906d7-da23-4e2d-ade8-a244dc3bdbbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:17.947630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-132906d7-da23-4e2d-ade8-a244dc3bdbbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:17.948067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-132906d7-da23-4e2d-ade8-a244dc3bdbbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:17.976701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-132906d7-da23-4e2d-ade8-a244dc3bdbbe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 Mar 08 13:23:17.977252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 341/676] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:18.220464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:18.221094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:18.226994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:18.227478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:18.228245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:18.228737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:18.359549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:18.368340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:18.373204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:18.373204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-936276a8-4552-4eef-8874-a975e5f0a584 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154722 Mar 08 13:23:18.373204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 336/677] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:18.941857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b9155129-a13d-4bf0-b65a-ac545fa56d1f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:18.942765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b9155129-a13d-4bf0-b65a-ac545fa56d1f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:18.948996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9155129-a13d-4bf0-b65a-ac545fa56d1f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:18.949465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9155129-a13d-4bf0-b65a-ac545fa56d1f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:18.950211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9155129-a13d-4bf0-b65a-ac545fa56d1f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:18.950646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9155129-a13d-4bf0-b65a-ac545fa56d1f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:18.978699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b9155129-a13d-4bf0-b65a-ac545fa56d1f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Mar 08 13:23:18.979247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 342/678] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:18.987567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8862adad-ed83-427d-a4ae-da6d4b138a28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:18.988515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8862adad-ed83-427d-a4ae-da6d4b138a28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:18.996199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8862adad-ed83-427d-a4ae-da6d4b138a28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:18.996646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8862adad-ed83-427d-a4ae-da6d4b138a28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:18.997441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8862adad-ed83-427d-a4ae-da6d4b138a28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:18.997874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8862adad-ed83-427d-a4ae-da6d4b138a28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:19.027085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8862adad-ed83-427d-a4ae-da6d4b138a28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043593 Mar 08 13:23:19.027554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 337/679] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:19.389511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:19.390115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:19.395992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:19.396438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:19.397227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:19.397659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:19.538659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:19.543956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:19.545477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:19.546784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1d13f26d-8e37-42b9-b801-acdac8738144 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.161140 Mar 08 13:23:19.547342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 343/680] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:19.989978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2efd5a8a-a24f-4e49-8ab4-23010d8a8ed1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:19.990841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2efd5a8a-a24f-4e49-8ab4-23010d8a8ed1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:19.997373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2efd5a8a-a24f-4e49-8ab4-23010d8a8ed1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:19.997812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2efd5a8a-a24f-4e49-8ab4-23010d8a8ed1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:19.998560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2efd5a8a-a24f-4e49-8ab4-23010d8a8ed1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:19.998988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2efd5a8a-a24f-4e49-8ab4-23010d8a8ed1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:20.027387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2efd5a8a-a24f-4e49-8ab4-23010d8a8ed1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Mar 08 13:23:20.027925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 338/681] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:20.038103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e7c3e48c-7cce-4621-beb3-eca9b4186236 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:20.039021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e7c3e48c-7cce-4621-beb3-eca9b4186236 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:20.045249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7c3e48c-7cce-4621-beb3-eca9b4186236 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:20.045690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7c3e48c-7cce-4621-beb3-eca9b4186236 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:20.046524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7c3e48c-7cce-4621-beb3-eca9b4186236 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:20.046950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7c3e48c-7cce-4621-beb3-eca9b4186236 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:20.075643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e7c3e48c-7cce-4621-beb3-eca9b4186236 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Mar 08 13:23:20.076174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 344/682] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:20.565919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:20.566534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:20.572532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:20.573309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:20.584475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:20.584475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:20.716044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:20.724896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:20.726370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:20.727507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-de190e1f-5063-48b8-abf8-36e7f802fd20 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.166384 Mar 08 13:23:20.728056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 339/683] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:21.039487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cf73a209-16aa-4b30-a0bf-d840e8beb93e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:21.040431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cf73a209-16aa-4b30-a0bf-d840e8beb93e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:21.046800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf73a209-16aa-4b30-a0bf-d840e8beb93e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:21.047250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf73a209-16aa-4b30-a0bf-d840e8beb93e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:21.048007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf73a209-16aa-4b30-a0bf-d840e8beb93e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:21.048441 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf73a209-16aa-4b30-a0bf-d840e8beb93e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:21.076323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cf73a209-16aa-4b30-a0bf-d840e8beb93e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040820 Mar 08 13:23:21.076891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 345/684] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:21.087151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5be1243e-37ce-4c95-a8b2-d78cfa9f3983 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:21.088051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5be1243e-37ce-4c95-a8b2-d78cfa9f3983 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:21.094332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5be1243e-37ce-4c95-a8b2-d78cfa9f3983 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:21.094779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5be1243e-37ce-4c95-a8b2-d78cfa9f3983 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:21.095569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5be1243e-37ce-4c95-a8b2-d78cfa9f3983 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:21.096095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5be1243e-37ce-4c95-a8b2-d78cfa9f3983 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:21.124095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5be1243e-37ce-4c95-a8b2-d78cfa9f3983 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041000 Mar 08 13:23:21.124630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 340/685] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:21.746771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:21.747368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:21.753337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:21.753782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:21.754542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:21.754973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:21.889188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:21.898240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:21.899757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:21.904616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-23b34c08-7576-4cb2-9851-94245999cdf9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158324 Mar 08 13:23:21.904616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 346/686] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:22.088363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-27d324f3-1234-47a0-afe2-f869794719a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:22.089295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-27d324f3-1234-47a0-afe2-f869794719a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:22.095461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27d324f3-1234-47a0-afe2-f869794719a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:22.096183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27d324f3-1234-47a0-afe2-f869794719a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:22.097696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27d324f3-1234-47a0-afe2-f869794719a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:22.098105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27d324f3-1234-47a0-afe2-f869794719a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:22.126182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-27d324f3-1234-47a0-afe2-f869794719a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 Mar 08 13:23:22.126661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 341/687] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:22.135343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4780121a-9c0e-4441-bfaf-05a4b9f850b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:22.136363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4780121a-9c0e-4441-bfaf-05a4b9f850b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:22.142649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4780121a-9c0e-4441-bfaf-05a4b9f850b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:22.143098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4780121a-9c0e-4441-bfaf-05a4b9f850b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:22.144461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4780121a-9c0e-4441-bfaf-05a4b9f850b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:22.144923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4780121a-9c0e-4441-bfaf-05a4b9f850b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:22.172631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4780121a-9c0e-4441-bfaf-05a4b9f850b5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041208 Mar 08 13:23:22.173204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 347/688] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:22.919328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:22.919874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:22.925785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:22.926240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:22.931127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:22.931127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:23.056792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:23.064889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:23.067034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:23.068177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d42624ad-33d2-4254-8243-32ce5ff795fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152796 Mar 08 13:23:23.068763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 342/689] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:23.137487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-85bf79a5-1e0b-43ce-9e2e-f6c1b5208281 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:23.138386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-85bf79a5-1e0b-43ce-9e2e-f6c1b5208281 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:23.146337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85bf79a5-1e0b-43ce-9e2e-f6c1b5208281 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:23.146859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85bf79a5-1e0b-43ce-9e2e-f6c1b5208281 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:23.147615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85bf79a5-1e0b-43ce-9e2e-f6c1b5208281 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:23.148109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85bf79a5-1e0b-43ce-9e2e-f6c1b5208281 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:23.175591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-85bf79a5-1e0b-43ce-9e2e-f6c1b5208281 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Mar 08 13:23:23.176128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 348/690] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:23.183304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c559fd9a-e309-419f-93d4-ceb827115125 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:23.184223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c559fd9a-e309-419f-93d4-ceb827115125 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:23.191044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c559fd9a-e309-419f-93d4-ceb827115125 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:23.191582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c559fd9a-e309-419f-93d4-ceb827115125 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:23.192343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c559fd9a-e309-419f-93d4-ceb827115125 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:23.192813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c559fd9a-e309-419f-93d4-ceb827115125 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:23.220344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c559fd9a-e309-419f-93d4-ceb827115125 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040926 Mar 08 13:23:23.220915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 343/691] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:24.086913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:24.087442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:24.093420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:24.096990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:24.096990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:24.096990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:24.187184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c77a2069-d6d6-4e4f-a16b-17b6862faa93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:24.188096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c77a2069-d6d6-4e4f-a16b-17b6862faa93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:24.195329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c77a2069-d6d6-4e4f-a16b-17b6862faa93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:24.195774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c77a2069-d6d6-4e4f-a16b-17b6862faa93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:24.196679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c77a2069-d6d6-4e4f-a16b-17b6862faa93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:24.197119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c77a2069-d6d6-4e4f-a16b-17b6862faa93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:24.227288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c77a2069-d6d6-4e4f-a16b-17b6862faa93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Mar 08 13:23:24.227897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 344/692] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:24.232560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bc384e95-23c6-4935-82aa-ac266b377d05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:24.233495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bc384e95-23c6-4935-82aa-ac266b377d05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:24.240299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc384e95-23c6-4935-82aa-ac266b377d05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:24.240775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc384e95-23c6-4935-82aa-ac266b377d05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:24.241555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc384e95-23c6-4935-82aa-ac266b377d05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:24.241983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc384e95-23c6-4935-82aa-ac266b377d05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:24.272297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bc384e95-23c6-4935-82aa-ac266b377d05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Mar 08 13:23:24.272912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 345/693] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:24.474721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:24.482675 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:24.484203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:24.485368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0293fafe-1dca-40c8-84aa-d9356c795cb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.402726 Mar 08 13:23:24.485915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 349/694] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:25.238281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aa739dc8-1639-4251-81c0-8062ab4a4174 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:25.239177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aa739dc8-1639-4251-81c0-8062ab4a4174 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:25.245604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa739dc8-1639-4251-81c0-8062ab4a4174 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:25.246051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa739dc8-1639-4251-81c0-8062ab4a4174 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:25.246805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa739dc8-1639-4251-81c0-8062ab4a4174 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:25.247236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa739dc8-1639-4251-81c0-8062ab4a4174 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:25.275543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aa739dc8-1639-4251-81c0-8062ab4a4174 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 Mar 08 13:23:25.276072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 346/695] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:25.283216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c2eb9261-5d79-4275-8fb7-73eb4cbfab93 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:25.284165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c2eb9261-5d79-4275-8fb7-73eb4cbfab93 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:25.290543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2eb9261-5d79-4275-8fb7-73eb4cbfab93 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:25.290985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2eb9261-5d79-4275-8fb7-73eb4cbfab93 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:25.291737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2eb9261-5d79-4275-8fb7-73eb4cbfab93 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:25.292166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2eb9261-5d79-4275-8fb7-73eb4cbfab93 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:25.321775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c2eb9261-5d79-4275-8fb7-73eb4cbfab93 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Mar 08 13:23:25.322517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 350/696] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:25.504622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:25.505203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:25.511074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:25.511524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:25.512288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:25.512754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:25.641821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:25.649973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:25.651466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:25.652642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-020b93f6-1787-4fcd-b00b-dd95d5cf5cd9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152620 Mar 08 13:23:25.653281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 347/697] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:26.287260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5bdd1909-6842-4801-97f0-c2512bade117 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:26.288217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5bdd1909-6842-4801-97f0-c2512bade117 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:26.295577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5bdd1909-6842-4801-97f0-c2512bade117 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:26.296257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5bdd1909-6842-4801-97f0-c2512bade117 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:26.297184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5bdd1909-6842-4801-97f0-c2512bade117 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:26.297617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5bdd1909-6842-4801-97f0-c2512bade117 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:26.327839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5bdd1909-6842-4801-97f0-c2512bade117 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Mar 08 13:23:26.328374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 351/698] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:26.333518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-32a771e1-381c-4682-930a-89e9b4618c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:26.334455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-32a771e1-381c-4682-930a-89e9b4618c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:26.341018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32a771e1-381c-4682-930a-89e9b4618c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:26.341490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32a771e1-381c-4682-930a-89e9b4618c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:26.342278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32a771e1-381c-4682-930a-89e9b4618c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:26.342720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-32a771e1-381c-4682-930a-89e9b4618c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:26.371736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-32a771e1-381c-4682-930a-89e9b4618c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042319 Mar 08 13:23:26.372280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 348/699] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:26.670526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:26.671076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:26.677797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:26.678334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:26.679134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:26.679582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:26.809656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:26.817947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:26.819432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:26.820571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6e99797d-abb2-4eab-82af-007f1fc4c945 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154013 Mar 08 13:23:26.821156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 352/700] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:27.339657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-96909a56-f87c-44db-96d8-a9f5872dd6df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:27.340620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-96909a56-f87c-44db-96d8-a9f5872dd6df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:27.347625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96909a56-f87c-44db-96d8-a9f5872dd6df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:27.348099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96909a56-f87c-44db-96d8-a9f5872dd6df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:27.348904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96909a56-f87c-44db-96d8-a9f5872dd6df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:27.349515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96909a56-f87c-44db-96d8-a9f5872dd6df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:27.377367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-96909a56-f87c-44db-96d8-a9f5872dd6df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041871 Mar 08 13:23:27.378199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 349/701] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:27.383439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5d6e77c3-aa0b-4b49-a06f-a48ee4fa346f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:27.384353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5d6e77c3-aa0b-4b49-a06f-a48ee4fa346f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:27.390686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d6e77c3-aa0b-4b49-a06f-a48ee4fa346f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:27.391136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d6e77c3-aa0b-4b49-a06f-a48ee4fa346f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:27.391900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d6e77c3-aa0b-4b49-a06f-a48ee4fa346f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:27.392336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d6e77c3-aa0b-4b49-a06f-a48ee4fa346f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:27.421344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5d6e77c3-aa0b-4b49-a06f-a48ee4fa346f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 Mar 08 13:23:27.421897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 353/702] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:27.839208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:27.839818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:27.845747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:27.846194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:27.847010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:27.847452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:28.035601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:28.045170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:28.046661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:28.047813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b436d313-f9fc-497d-a42d-6edf29f23c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.212512 Mar 08 13:23:28.048377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 350/703] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:28.389110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-99ddfe30-1bc0-4394-bdb0-f94452bcf785 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:28.390055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-99ddfe30-1bc0-4394-bdb0-f94452bcf785 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:28.396650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99ddfe30-1bc0-4394-bdb0-f94452bcf785 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:28.397126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99ddfe30-1bc0-4394-bdb0-f94452bcf785 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:28.397888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99ddfe30-1bc0-4394-bdb0-f94452bcf785 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:28.398326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99ddfe30-1bc0-4394-bdb0-f94452bcf785 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:28.427279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-99ddfe30-1bc0-4394-bdb0-f94452bcf785 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042258 Mar 08 13:23:28.427866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 354/704] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:28.433190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e19e6c56-7e2f-49ba-bd66-853372ca6d80 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:28.434096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e19e6c56-7e2f-49ba-bd66-853372ca6d80 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:28.440245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e19e6c56-7e2f-49ba-bd66-853372ca6d80 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:28.441003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e19e6c56-7e2f-49ba-bd66-853372ca6d80 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:28.441938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e19e6c56-7e2f-49ba-bd66-853372ca6d80 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:28.442378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e19e6c56-7e2f-49ba-bd66-853372ca6d80 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:28.469765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e19e6c56-7e2f-49ba-bd66-853372ca6d80 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040555 Mar 08 13:23:28.470315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 351/705] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:29.070060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:29.070664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:29.076423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:29.076900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:29.077654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:29.078090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:29.209859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:29.217863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:29.219352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:29.220490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-948375cb-f3da-4b08-8d7d-893ec11d83ac tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154781 Mar 08 13:23:29.221064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 355/706] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:29.438294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eb1fb83d-c913-426e-8766-253ea8a1ae34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:29.439201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eb1fb83d-c913-426e-8766-253ea8a1ae34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:29.445928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb1fb83d-c913-426e-8766-253ea8a1ae34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:29.446381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb1fb83d-c913-426e-8766-253ea8a1ae34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:29.447151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb1fb83d-c913-426e-8766-253ea8a1ae34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:29.447589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb1fb83d-c913-426e-8766-253ea8a1ae34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:29.476895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eb1fb83d-c913-426e-8766-253ea8a1ae34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 Mar 08 13:23:29.477381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 352/707] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:29.481670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-767e2aeb-3675-48c1-be59-c88092afb6cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:29.482588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-767e2aeb-3675-48c1-be59-c88092afb6cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:29.488838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767e2aeb-3675-48c1-be59-c88092afb6cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:29.489289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767e2aeb-3675-48c1-be59-c88092afb6cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:29.490052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767e2aeb-3675-48c1-be59-c88092afb6cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:29.490488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767e2aeb-3675-48c1-be59-c88092afb6cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:29.518479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-767e2aeb-3675-48c1-be59-c88092afb6cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040712 Mar 08 13:23:29.519547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 356/708] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:30.240517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:30.241156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:30.247197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:30.247660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:30.248414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:30.248884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:30.377982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:30.387422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:30.388948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:30.390088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c4316de7-53e4-4bf9-8cb9-ad0d9fb75d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155048 Mar 08 13:23:30.390645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 353/709] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:30.488359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-767dc92d-7346-4adf-b3a6-97399b3ffe51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:30.489292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-767dc92d-7346-4adf-b3a6-97399b3ffe51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:30.495750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767dc92d-7346-4adf-b3a6-97399b3ffe51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:30.496194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767dc92d-7346-4adf-b3a6-97399b3ffe51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:30.496986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767dc92d-7346-4adf-b3a6-97399b3ffe51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:30.497489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-767dc92d-7346-4adf-b3a6-97399b3ffe51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:30.526813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-767dc92d-7346-4adf-b3a6-97399b3ffe51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 Mar 08 13:23:30.527361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 357/710] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:30.531045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d90d0fe-f1a1-4161-8b0f-4ad1d4c2ed56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:30.531942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d90d0fe-f1a1-4161-8b0f-4ad1d4c2ed56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:30.538307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d90d0fe-f1a1-4161-8b0f-4ad1d4c2ed56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:30.538825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d90d0fe-f1a1-4161-8b0f-4ad1d4c2ed56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:30.539577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d90d0fe-f1a1-4161-8b0f-4ad1d4c2ed56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:30.540007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d90d0fe-f1a1-4161-8b0f-4ad1d4c2ed56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:30.577524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d90d0fe-f1a1-4161-8b0f-4ad1d4c2ed56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050779 Mar 08 13:23:30.578061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 354/711] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:31.409125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:31.409760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:31.415633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:31.416097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:31.416893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:31.417324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:31.538385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0c3e837-cda7-4f77-af89-6fee08dbab34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:31.539285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0c3e837-cda7-4f77-af89-6fee08dbab34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:31.545644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:31.546394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c3e837-cda7-4f77-af89-6fee08dbab34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:31.546838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c3e837-cda7-4f77-af89-6fee08dbab34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:31.547637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c3e837-cda7-4f77-af89-6fee08dbab34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:31.548068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c3e837-cda7-4f77-af89-6fee08dbab34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:31.554433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:31.555932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:31.557123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b802b80-08cf-4a8f-bfb1-002325fa61c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151928 Mar 08 13:23:31.557678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 358/712] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:31.576999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0c3e837-cda7-4f77-af89-6fee08dbab34 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Mar 08 13:23:31.577526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 355/713] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:31.589584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1ef9b119-6447-4ccc-a2c7-3e1efb07fca4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:31.590492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1ef9b119-6447-4ccc-a2c7-3e1efb07fca4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:31.596275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ef9b119-6447-4ccc-a2c7-3e1efb07fca4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:31.596761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ef9b119-6447-4ccc-a2c7-3e1efb07fca4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:31.597733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ef9b119-6447-4ccc-a2c7-3e1efb07fca4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:31.598225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ef9b119-6447-4ccc-a2c7-3e1efb07fca4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:31.626781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1ef9b119-6447-4ccc-a2c7-3e1efb07fca4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041110 Mar 08 13:23:31.627325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 359/714] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:32.575446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:32.575969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:32.584085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:32.584539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:32.585388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:32.585825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:32.588591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f2d0343e-189c-474d-a23f-39f2817ba2bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:32.589579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f2d0343e-189c-474d-a23f-39f2817ba2bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:32.595309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0343e-189c-474d-a23f-39f2817ba2bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:32.595754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0343e-189c-474d-a23f-39f2817ba2bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:32.596508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0343e-189c-474d-a23f-39f2817ba2bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:32.597079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f2d0343e-189c-474d-a23f-39f2817ba2bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:32.626478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f2d0343e-189c-474d-a23f-39f2817ba2bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041714 Mar 08 13:23:32.627052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 360/715] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:32.638209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a2c9014-b387-49cc-b772-f9c5a27d1b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:32.639104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a2c9014-b387-49cc-b772-f9c5a27d1b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:32.645600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a2c9014-b387-49cc-b772-f9c5a27d1b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:32.646038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a2c9014-b387-49cc-b772-f9c5a27d1b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:32.646804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a2c9014-b387-49cc-b772-f9c5a27d1b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:32.647243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a2c9014-b387-49cc-b772-f9c5a27d1b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:32.676003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a2c9014-b387-49cc-b772-f9c5a27d1b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 Mar 08 13:23:32.676560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 361/716] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:32.932369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:32.940449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:32.942557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:32.943713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9fa35a10-4631-4fe1-be68-c29d30eaaa4a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.372228 Mar 08 13:23:32.944270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 356/717] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:32 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:33.638190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-db439736-ce03-4dbf-b395-22031e31fced tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:33.639023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-db439736-ce03-4dbf-b395-22031e31fced tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:33.645456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db439736-ce03-4dbf-b395-22031e31fced tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:33.645907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db439736-ce03-4dbf-b395-22031e31fced tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:33.646672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db439736-ce03-4dbf-b395-22031e31fced tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:33.647111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db439736-ce03-4dbf-b395-22031e31fced tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:33.674926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-db439736-ce03-4dbf-b395-22031e31fced tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040737 Mar 08 13:23:33.676088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 362/718] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:33.687206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b938d7fb-dd61-4c3c-beca-8f0e0448a862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:33.688206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b938d7fb-dd61-4c3c-beca-8f0e0448a862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:33.694480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b938d7fb-dd61-4c3c-beca-8f0e0448a862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:33.694926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b938d7fb-dd61-4c3c-beca-8f0e0448a862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:33.695678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b938d7fb-dd61-4c3c-beca-8f0e0448a862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:33.696108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b938d7fb-dd61-4c3c-beca-8f0e0448a862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:33.723406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b938d7fb-dd61-4c3c-beca-8f0e0448a862 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040060 Mar 08 13:23:33.723929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 357/719] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:33.962380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:33.967449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:33.968682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:33.969122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:33.969874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:33.970305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:34.109959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:34.118921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:34.120726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:34.121887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d7d41940-5d32-4c24-b26e-e1a875120ff9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163425 Mar 08 13:23:34.122457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 363/720] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:34.686886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eb413952-fa22-4d70-a9b1-832186dcf65a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:34.687818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eb413952-fa22-4d70-a9b1-832186dcf65a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:34.694552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb413952-fa22-4d70-a9b1-832186dcf65a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:34.695004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb413952-fa22-4d70-a9b1-832186dcf65a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:34.695766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb413952-fa22-4d70-a9b1-832186dcf65a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:34.696201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb413952-fa22-4d70-a9b1-832186dcf65a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:34.723169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eb413952-fa22-4d70-a9b1-832186dcf65a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040222 Mar 08 13:23:34.723692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 358/721] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:34.734648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0dd56a8f-6abd-495d-abcc-1546e3a6224e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:34.735554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0dd56a8f-6abd-495d-abcc-1546e3a6224e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:34.742397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0dd56a8f-6abd-495d-abcc-1546e3a6224e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:34.742873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0dd56a8f-6abd-495d-abcc-1546e3a6224e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:34.743625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0dd56a8f-6abd-495d-abcc-1546e3a6224e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:34.744057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0dd56a8f-6abd-495d-abcc-1546e3a6224e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:34.772586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0dd56a8f-6abd-495d-abcc-1546e3a6224e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 Mar 08 13:23:34.773153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 364/722] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:35.140682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:35.141219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:35.147845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:35.148296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:35.149095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:35.149533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:35.280621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:35.288997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:35.290501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:35.291647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-daea4fea-88b0-4bd6-b747-e88c9de724d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154990 Mar 08 13:23:35.292216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 359/723] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:35.733754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d6806aaa-a4f5-4a55-b3dd-043de3379202 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:35.734686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d6806aaa-a4f5-4a55-b3dd-043de3379202 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:35.742125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d6806aaa-a4f5-4a55-b3dd-043de3379202 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:35.742567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d6806aaa-a4f5-4a55-b3dd-043de3379202 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:35.743329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d6806aaa-a4f5-4a55-b3dd-043de3379202 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:35.743757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d6806aaa-a4f5-4a55-b3dd-043de3379202 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:35.782140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d6806aaa-a4f5-4a55-b3dd-043de3379202 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052114 Mar 08 13:23:35.785224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 365/724] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:35.785353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-23ed8140-5faa-4fe5-8d36-f1e95485b115 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:35.785353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-23ed8140-5faa-4fe5-8d36-f1e95485b115 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:35.791935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23ed8140-5faa-4fe5-8d36-f1e95485b115 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:35.792387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23ed8140-5faa-4fe5-8d36-f1e95485b115 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:35.793200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23ed8140-5faa-4fe5-8d36-f1e95485b115 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:35.793634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23ed8140-5faa-4fe5-8d36-f1e95485b115 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:35.825076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-23ed8140-5faa-4fe5-8d36-f1e95485b115 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Mar 08 13:23:35.825630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 360/725] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:36.310511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:36.311157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:36.316927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:36.321034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:36.321034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:36.321034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:36.461228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:36.470216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:36.471715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:36.473654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e1db3767-8f38-42c7-9e79-953fc2c59a23 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.167163 Mar 08 13:23:36.474231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 366/726] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:36.794714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d79b26d4-2ca2-4b56-824c-88728c49b118 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:36.795615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d79b26d4-2ca2-4b56-824c-88728c49b118 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:36.802412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d79b26d4-2ca2-4b56-824c-88728c49b118 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:36.802852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d79b26d4-2ca2-4b56-824c-88728c49b118 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:36.803613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d79b26d4-2ca2-4b56-824c-88728c49b118 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:36.804048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d79b26d4-2ca2-4b56-824c-88728c49b118 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:36.832476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d79b26d4-2ca2-4b56-824c-88728c49b118 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041663 Mar 08 13:23:36.833064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 361/727] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:36.836732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-079c5d36-c20b-467d-a991-57421b51892d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:36.837866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-079c5d36-c20b-467d-a991-57421b51892d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:36.844873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-079c5d36-c20b-467d-a991-57421b51892d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:36.845317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-079c5d36-c20b-467d-a991-57421b51892d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:36.846079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-079c5d36-c20b-467d-a991-57421b51892d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:36.846505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-079c5d36-c20b-467d-a991-57421b51892d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:36.876426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-079c5d36-c20b-467d-a991-57421b51892d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043733 Mar 08 13:23:36.877005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 367/728] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:37.492547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:37.493314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:37.499762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:37.500216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:37.501029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:37.501473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:37.636624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:37.644943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:37.646458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:37.647625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f597966b-10b6-44f4-ae7f-a9015fafab45 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159663 Mar 08 13:23:37.648183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 362/729] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:37 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:23:37.845610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e7821a00-2b0d-4649-991b-c5429607896e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:37.846461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e7821a00-2b0d-4649-991b-c5429607896e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:37.853106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7821a00-2b0d-4649-991b-c5429607896e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:37.853554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7821a00-2b0d-4649-991b-c5429607896e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:37.854494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7821a00-2b0d-4649-991b-c5429607896e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:37.855009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e7821a00-2b0d-4649-991b-c5429607896e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:37.885339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e7821a00-2b0d-4649-991b-c5429607896e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Mar 08 13:23:37.886040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 368/730] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:37.889016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77730a01-f944-4a4c-b41f-d88682ae0951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:37.889923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77730a01-f944-4a4c-b41f-d88682ae0951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:37.896497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77730a01-f944-4a4c-b41f-d88682ae0951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:37.896974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77730a01-f944-4a4c-b41f-d88682ae0951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:37.897731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77730a01-f944-4a4c-b41f-d88682ae0951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:37.898274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77730a01-f944-4a4c-b41f-d88682ae0951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:37.931995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77730a01-f944-4a4c-b41f-d88682ae0951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047043 Mar 08 13:23:37.932619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 363/731] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:38.666551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:38.667086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:38.673006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:38.673451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:38.674208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:38.674641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:38.812857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:38.821790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:38.823297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:38.824458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6c00168e-71d5-4303-9706-7c02cdd4e343 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.161823 Mar 08 13:23:38.825044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 369/732] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:38 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:38.896697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-14fda9a9-8335-49c3-841f-743d8d74d3f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:38.897629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-14fda9a9-8335-49c3-841f-743d8d74d3f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:38.903841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14fda9a9-8335-49c3-841f-743d8d74d3f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:38.904295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14fda9a9-8335-49c3-841f-743d8d74d3f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:38.905087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14fda9a9-8335-49c3-841f-743d8d74d3f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:38.905522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14fda9a9-8335-49c3-841f-743d8d74d3f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:38.932946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-14fda9a9-8335-49c3-841f-743d8d74d3f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040832 Mar 08 13:23:38.933494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 364/733] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:38.944306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f71adb20-7a7b-427a-962e-c064cbc39a2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:38.945261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f71adb20-7a7b-427a-962e-c064cbc39a2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:38.951454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f71adb20-7a7b-427a-962e-c064cbc39a2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:38.951910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f71adb20-7a7b-427a-962e-c064cbc39a2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:38.952712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f71adb20-7a7b-427a-962e-c064cbc39a2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:38.953157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f71adb20-7a7b-427a-962e-c064cbc39a2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:38.981171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f71adb20-7a7b-427a-962e-c064cbc39a2c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041343 Mar 08 13:23:38.981719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 370/734] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:39.843482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:39.844083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:39.850930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:39.851568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:39.852641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:39.853303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:39.944437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f59b7f09-97bb-4344-a319-04575f28652c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:39.945492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f59b7f09-97bb-4344-a319-04575f28652c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:39.951527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f59b7f09-97bb-4344-a319-04575f28652c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:39.951973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f59b7f09-97bb-4344-a319-04575f28652c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:39.952795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f59b7f09-97bb-4344-a319-04575f28652c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:39.953231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f59b7f09-97bb-4344-a319-04575f28652c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:39.982209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f59b7f09-97bb-4344-a319-04575f28652c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041673 Mar 08 13:23:39.982758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 371/735] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:39.990610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:39.991579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9b074d94-d5c9-4ef6-8d82-07cd18d35f61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:39.992471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9b074d94-d5c9-4ef6-8d82-07cd18d35f61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:39.998330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b074d94-d5c9-4ef6-8d82-07cd18d35f61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:39.998777 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b074d94-d5c9-4ef6-8d82-07cd18d35f61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:39.999350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:39.999545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b074d94-d5c9-4ef6-8d82-07cd18d35f61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:39.999957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b074d94-d5c9-4ef6-8d82-07cd18d35f61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:40.000899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:40.002066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e4cf87c6-5c72-41c0-830f-f0b838ac42fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162605 Mar 08 13:23:40.002620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 365/736] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:40.028961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9b074d94-d5c9-4ef6-8d82-07cd18d35f61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041065 Mar 08 13:23:40.029502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 372/737] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:40.993055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7968d5b6-f311-4cff-a1ee-f0a59d70c7fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:40.993967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7968d5b6-f311-4cff-a1ee-f0a59d70c7fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:41.000462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7968d5b6-f311-4cff-a1ee-f0a59d70c7fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:41.000947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7968d5b6-f311-4cff-a1ee-f0a59d70c7fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:41.001713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7968d5b6-f311-4cff-a1ee-f0a59d70c7fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:41.002150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7968d5b6-f311-4cff-a1ee-f0a59d70c7fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:41.021186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:41.021939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:41.028093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:41.028548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:41.029350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:41.029788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:41.031729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7968d5b6-f311-4cff-a1ee-f0a59d70c7fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Mar 08 13:23:41.032491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 366/738] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:41.039074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a5b2d68-ca7f-48ae-a349-2b7d04ef661e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:41.039966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a5b2d68-ca7f-48ae-a349-2b7d04ef661e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:41.045761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5b2d68-ca7f-48ae-a349-2b7d04ef661e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:41.046211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5b2d68-ca7f-48ae-a349-2b7d04ef661e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:41.047497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5b2d68-ca7f-48ae-a349-2b7d04ef661e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:41.047497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a5b2d68-ca7f-48ae-a349-2b7d04ef661e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:41.076217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a5b2d68-ca7f-48ae-a349-2b7d04ef661e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040781 Mar 08 13:23:41.076813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 367/739] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:41.161700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:41.169748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:41.171256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:41.172394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9c39258e-651e-4de6-bfea-ba3d6e97cfe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155660 Mar 08 13:23:41.172992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 373/740] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:23:42.043513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b4d51eee-3617-46d8-a509-85d64ff9f0e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:42.044443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b4d51eee-3617-46d8-a509-85d64ff9f0e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:42.050683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4d51eee-3617-46d8-a509-85d64ff9f0e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:42.051691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4d51eee-3617-46d8-a509-85d64ff9f0e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:42.052447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4d51eee-3617-46d8-a509-85d64ff9f0e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:42.052908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4d51eee-3617-46d8-a509-85d64ff9f0e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:42.080800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b4d51eee-3617-46d8-a509-85d64ff9f0e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Mar 08 13:23:42.081336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 368/741] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:42.087779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7aa6aca4-0567-4906-bf4d-10dac7cc07d9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:42.088751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7aa6aca4-0567-4906-bf4d-10dac7cc07d9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:42.094998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7aa6aca4-0567-4906-bf4d-10dac7cc07d9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:42.095443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7aa6aca4-0567-4906-bf4d-10dac7cc07d9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:42.096208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7aa6aca4-0567-4906-bf4d-10dac7cc07d9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:42.096646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7aa6aca4-0567-4906-bf4d-10dac7cc07d9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:42.124611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7aa6aca4-0567-4906-bf4d-10dac7cc07d9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040716 Mar 08 13:23:42.125211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 374/742] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:42.190490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:42.191097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:42.197665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:42.198113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:42.198872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:42.199309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:42.326739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:42.335066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:42.336563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:42.337744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e4ecd238-9198-4735-83f4-a565ec24dfda tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151087 Mar 08 13:23:42.338302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 369/743] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:43.092621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3e4df86c-e018-4a87-9c81-f13962b236f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:43.093550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3e4df86c-e018-4a87-9c81-f13962b236f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:43.099772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e4df86c-e018-4a87-9c81-f13962b236f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:43.100214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e4df86c-e018-4a87-9c81-f13962b236f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:43.101003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e4df86c-e018-4a87-9c81-f13962b236f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:43.101430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e4df86c-e018-4a87-9c81-f13962b236f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:43.129241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3e4df86c-e018-4a87-9c81-f13962b236f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040579 Mar 08 13:23:43.129786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 375/744] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:43.136509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6d8aedfc-4f96-4824-8bfe-aa6ada1627c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:43.137440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6d8aedfc-4f96-4824-8bfe-aa6ada1627c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:43.143605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d8aedfc-4f96-4824-8bfe-aa6ada1627c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:43.144045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d8aedfc-4f96-4824-8bfe-aa6ada1627c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:43.144835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d8aedfc-4f96-4824-8bfe-aa6ada1627c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:43.145268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d8aedfc-4f96-4824-8bfe-aa6ada1627c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:43.172679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6d8aedfc-4f96-4824-8bfe-aa6ada1627c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039964 Mar 08 13:23:43.173217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 370/745] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:43.355975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:43.356581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:43.362479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:43.362927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:43.363686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:43.364123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:43.492832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:43.501308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:43.502842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:43.503988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b2a4905-475d-48f8-ae55-0e9afb5653d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151967 Mar 08 13:23:43.504548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 376/746] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:44.141179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-57244274-b692-47f4-bc61-c736041af617 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:44.142034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-57244274-b692-47f4-bc61-c736041af617 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:44.149098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57244274-b692-47f4-bc61-c736041af617 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:44.149543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57244274-b692-47f4-bc61-c736041af617 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:44.150306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57244274-b692-47f4-bc61-c736041af617 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:44.150740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57244274-b692-47f4-bc61-c736041af617 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:44.180311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-57244274-b692-47f4-bc61-c736041af617 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 Mar 08 13:23:44.180903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 371/747] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:44.183947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-699fcecb-3960-4fe0-961b-130d7cd6972d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:44.184904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-699fcecb-3960-4fe0-961b-130d7cd6972d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:44.191217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699fcecb-3960-4fe0-961b-130d7cd6972d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:44.191662 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699fcecb-3960-4fe0-961b-130d7cd6972d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:44.192428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699fcecb-3960-4fe0-961b-130d7cd6972d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:44.192873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699fcecb-3960-4fe0-961b-130d7cd6972d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:44.220694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-699fcecb-3960-4fe0-961b-130d7cd6972d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040585 Mar 08 13:23:44.221236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 377/748] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:44.523233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:44.523839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:44.529703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:44.530159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:44.530927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:44.531367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:44.674081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:44.683490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:44.685016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:44.686169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e06c728c-6eef-493f-a294-3f623e9ae840 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.167526 Mar 08 13:23:44.686875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 372/749] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:45.191680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bddd6d24-b47f-4d79-952b-2e63facbdd41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:45.192577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bddd6d24-b47f-4d79-952b-2e63facbdd41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:45.198947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bddd6d24-b47f-4d79-952b-2e63facbdd41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:45.199386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bddd6d24-b47f-4d79-952b-2e63facbdd41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:45.200140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bddd6d24-b47f-4d79-952b-2e63facbdd41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:45.200589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bddd6d24-b47f-4d79-952b-2e63facbdd41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:45.231457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bddd6d24-b47f-4d79-952b-2e63facbdd41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Mar 08 13:23:45.232193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 378/750] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:45.232901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-12847656-f5f4-4df7-b5ea-f7b5c1915c1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:45.233813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-12847656-f5f4-4df7-b5ea-f7b5c1915c1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:45.240035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12847656-f5f4-4df7-b5ea-f7b5c1915c1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:45.240612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12847656-f5f4-4df7-b5ea-f7b5c1915c1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:45.241620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12847656-f5f4-4df7-b5ea-f7b5c1915c1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:45.242138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12847656-f5f4-4df7-b5ea-f7b5c1915c1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:45.272483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-12847656-f5f4-4df7-b5ea-f7b5c1915c1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Mar 08 13:23:45.273054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 373/751] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:45.704959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:45.705568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:45.711790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:45.712240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:45.713060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:45.713492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:45.859117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:45.867450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:45.868983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:45.870131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0c1aab58-0853-49fb-b228-16a79a0b2a91 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.169104 Mar 08 13:23:45.870959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 379/752] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:46.244046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-faeb89be-9a85-4bcc-afd4-b68d2cab1e6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:46.244995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-faeb89be-9a85-4bcc-afd4-b68d2cab1e6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:46.251713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-faeb89be-9a85-4bcc-afd4-b68d2cab1e6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:46.252166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-faeb89be-9a85-4bcc-afd4-b68d2cab1e6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:46.252969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-faeb89be-9a85-4bcc-afd4-b68d2cab1e6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:46.253406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-faeb89be-9a85-4bcc-afd4-b68d2cab1e6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:46.280633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-faeb89be-9a85-4bcc-afd4-b68d2cab1e6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 Mar 08 13:23:46.281213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 374/753] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:46.283445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a78969af-8f8d-4e3b-8fbc-53267674551b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:46.284358 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a78969af-8f8d-4e3b-8fbc-53267674551b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:46.291486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a78969af-8f8d-4e3b-8fbc-53267674551b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:46.291936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a78969af-8f8d-4e3b-8fbc-53267674551b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:46.292746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a78969af-8f8d-4e3b-8fbc-53267674551b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:46.293182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a78969af-8f8d-4e3b-8fbc-53267674551b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:46.322365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a78969af-8f8d-4e3b-8fbc-53267674551b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 Mar 08 13:23:46.323160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 380/754] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:46.889448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:46.890049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:46.895938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:46.896383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:46.897170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:46.897599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:47.027574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:47.035636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:47.037155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:47.038298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6b30ca9c-b995-4d43-b157-a1ade1246372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152807 Mar 08 13:23:47.038845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 375/755] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:47.292634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6ad42611-1844-4b2e-a23f-d4d1577ba4b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:47.293590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6ad42611-1844-4b2e-a23f-d4d1577ba4b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:47.300978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ad42611-1844-4b2e-a23f-d4d1577ba4b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:47.301532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ad42611-1844-4b2e-a23f-d4d1577ba4b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:47.302349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ad42611-1844-4b2e-a23f-d4d1577ba4b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:47.302826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ad42611-1844-4b2e-a23f-d4d1577ba4b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:47.331432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6ad42611-1844-4b2e-a23f-d4d1577ba4b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043488 Mar 08 13:23:47.331988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 381/756] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:47.333744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b466477a-2ca1-4c36-9601-d2fe1a191e79 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:47.334657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b466477a-2ca1-4c36-9601-d2fe1a191e79 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:47.341019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b466477a-2ca1-4c36-9601-d2fe1a191e79 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:47.341473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b466477a-2ca1-4c36-9601-d2fe1a191e79 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:47.342243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b466477a-2ca1-4c36-9601-d2fe1a191e79 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:47.342745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b466477a-2ca1-4c36-9601-d2fe1a191e79 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:47.373447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b466477a-2ca1-4c36-9601-d2fe1a191e79 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Mar 08 13:23:47.374010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 376/757] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:48.055608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:48.056856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:48.062714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:48.063102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:48.063858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:48.064292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:48.200762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:48.212285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:48.213840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:48.215038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6031d9a6-65cb-4437-9120-e88e6f762812 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163513 Mar 08 13:23:48.215590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 382/758] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:48 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:48.343578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2d1706ee-b801-4eae-b604-86b06ed50b10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:48.345118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2d1706ee-b801-4eae-b604-86b06ed50b10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:48.351604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d1706ee-b801-4eae-b604-86b06ed50b10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:48.352056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d1706ee-b801-4eae-b604-86b06ed50b10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:48.353564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d1706ee-b801-4eae-b604-86b06ed50b10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:48.354012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d1706ee-b801-4eae-b604-86b06ed50b10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:48.381927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2d1706ee-b801-4eae-b604-86b06ed50b10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042356 Mar 08 13:23:48.382488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 377/759] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:48.385147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5603381a-6803-46b9-9b16-2bf55969afcd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:48.386121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5603381a-6803-46b9-9b16-2bf55969afcd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:48.392440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5603381a-6803-46b9-9b16-2bf55969afcd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:48.393098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5603381a-6803-46b9-9b16-2bf55969afcd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:48.393902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5603381a-6803-46b9-9b16-2bf55969afcd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:48.394336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5603381a-6803-46b9-9b16-2bf55969afcd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:48.424342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5603381a-6803-46b9-9b16-2bf55969afcd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 Mar 08 13:23:48.424923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 383/760] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:49.233076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:49.233681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:49.239587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:49.240030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:49.240810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:49.241244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:49.377633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:49.385716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:49.387238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:49.388376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c41f5d80-3107-4d6d-b010-b4704c8d535f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159115 Mar 08 13:23:49.388971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 378/761] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:49.393780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-758a75c2-559e-4ee1-80bc-412c38a0bd9e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:49.394689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-758a75c2-559e-4ee1-80bc-412c38a0bd9e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:49.401612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-758a75c2-559e-4ee1-80bc-412c38a0bd9e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:49.402069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-758a75c2-559e-4ee1-80bc-412c38a0bd9e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:49.402832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-758a75c2-559e-4ee1-80bc-412c38a0bd9e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:49.403265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-758a75c2-559e-4ee1-80bc-412c38a0bd9e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:49.431578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-758a75c2-559e-4ee1-80bc-412c38a0bd9e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041785 Mar 08 13:23:49.432118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 384/762] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:49.435384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9fcb8104-c172-4787-8578-b74603356136 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:49.436321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9fcb8104-c172-4787-8578-b74603356136 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:49.442052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fcb8104-c172-4787-8578-b74603356136 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:49.442522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fcb8104-c172-4787-8578-b74603356136 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:49.443284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fcb8104-c172-4787-8578-b74603356136 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:49.443713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fcb8104-c172-4787-8578-b74603356136 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:49.472008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9fcb8104-c172-4787-8578-b74603356136 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040563 Mar 08 13:23:49.472547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 379/763] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:50.406942 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:50.407547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:50.413786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:50.414234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:50.414990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:50.415593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:50.443317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2a34bfdc-50a7-4531-98ad-88515cf2f9e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:50.444213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2a34bfdc-50a7-4531-98ad-88515cf2f9e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:50.455448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a34bfdc-50a7-4531-98ad-88515cf2f9e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:50.455448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a34bfdc-50a7-4531-98ad-88515cf2f9e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:50.455448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a34bfdc-50a7-4531-98ad-88515cf2f9e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:50.455448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a34bfdc-50a7-4531-98ad-88515cf2f9e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:50.481892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2a34bfdc-50a7-4531-98ad-88515cf2f9e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Mar 08 13:23:50.482752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 380/764] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:50.487279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-81d1646d-a456-4701-86e0-490b74b0b8a4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:50.488167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-81d1646d-a456-4701-86e0-490b74b0b8a4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:50.494483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81d1646d-a456-4701-86e0-490b74b0b8a4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:50.494934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81d1646d-a456-4701-86e0-490b74b0b8a4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:50.495698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81d1646d-a456-4701-86e0-490b74b0b8a4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:50.496389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81d1646d-a456-4701-86e0-490b74b0b8a4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:50.525995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-81d1646d-a456-4701-86e0-490b74b0b8a4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 Mar 08 13:23:50.526559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 381/765] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:50.602595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:50.610906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:50.612382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:50.613546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-38ed4cca-22c7-4111-9250-35e46846fbfe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.210601 Mar 08 13:23:50.614094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 385/766] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:51.492418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-93bb9823-2134-4570-9da9-d0f9f681e5e5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:51.493358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-93bb9823-2134-4570-9da9-d0f9f681e5e5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:51.499809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bb9823-2134-4570-9da9-d0f9f681e5e5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:51.500252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bb9823-2134-4570-9da9-d0f9f681e5e5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:51.501029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bb9823-2134-4570-9da9-d0f9f681e5e5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:51.501464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bb9823-2134-4570-9da9-d0f9f681e5e5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:51.528944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-93bb9823-2134-4570-9da9-d0f9f681e5e5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040438 Mar 08 13:23:51.529481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 382/767] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:51.537461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ab77ced5-309d-4537-b3e6-4b93bd0826f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:51.538370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ab77ced5-309d-4537-b3e6-4b93bd0826f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:51.545261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab77ced5-309d-4537-b3e6-4b93bd0826f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:51.545710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab77ced5-309d-4537-b3e6-4b93bd0826f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:51.546468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab77ced5-309d-4537-b3e6-4b93bd0826f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:51.546901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab77ced5-309d-4537-b3e6-4b93bd0826f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:51.573823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ab77ced5-309d-4537-b3e6-4b93bd0826f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040226 Mar 08 13:23:51.574368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 386/768] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:51.632412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:51.633002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:51.639550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:51.640019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:51.640819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:51.641260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:51.818465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:51.827294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:51.829123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:51.830551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6e026808-adb6-4392-aef2-6c3ece99500e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.202118 Mar 08 13:23:51.831362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 383/769] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:52.596323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2b21bd21-a46e-4301-a630-ca961df37d51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:52.596323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2b21bd21-a46e-4301-a630-ca961df37d51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:52.596323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b21bd21-a46e-4301-a630-ca961df37d51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:52.596323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b21bd21-a46e-4301-a630-ca961df37d51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:52.597099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b21bd21-a46e-4301-a630-ca961df37d51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:52.597099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b21bd21-a46e-4301-a630-ca961df37d51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:52.597099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2b21bd21-a46e-4301-a630-ca961df37d51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 Mar 08 13:23:52.597099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 387/770] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:52.597376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b138e337-efc9-45ad-a4b6-322d622bdd75 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:52.597376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b138e337-efc9-45ad-a4b6-322d622bdd75 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:52.603588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b138e337-efc9-45ad-a4b6-322d622bdd75 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:52.604167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b138e337-efc9-45ad-a4b6-322d622bdd75 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:52.605010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b138e337-efc9-45ad-a4b6-322d622bdd75 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:52.605461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b138e337-efc9-45ad-a4b6-322d622bdd75 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:52.634776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b138e337-efc9-45ad-a4b6-322d622bdd75 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046641 Mar 08 13:23:52.635144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 384/771] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:52.852214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:52.852952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:52.858671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:52.859114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:52.859871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:52.860303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:52.993299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:53.001804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:53.003288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:53.004412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-18225bed-3abd-46a6-9420-b1ea1ccff461 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156221 Mar 08 13:23:53.005000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 388/772] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:53.590924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f0f54445-f9a7-481c-a140-c983eade4938 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:53.591818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f0f54445-f9a7-481c-a140-c983eade4938 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:53.598177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0f54445-f9a7-481c-a140-c983eade4938 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:53.598821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0f54445-f9a7-481c-a140-c983eade4938 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:53.599365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0f54445-f9a7-481c-a140-c983eade4938 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:53.599794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0f54445-f9a7-481c-a140-c983eade4938 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:53.627890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f0f54445-f9a7-481c-a140-c983eade4938 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041496 Mar 08 13:23:53.628425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 385/773] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:53.645899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-359d6682-8d6f-44b6-8666-9f8753238a2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:53.646845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-359d6682-8d6f-44b6-8666-9f8753238a2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:53.653312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359d6682-8d6f-44b6-8666-9f8753238a2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:53.653765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359d6682-8d6f-44b6-8666-9f8753238a2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:53.654557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359d6682-8d6f-44b6-8666-9f8753238a2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:53.654996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359d6682-8d6f-44b6-8666-9f8753238a2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:53.682917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-359d6682-8d6f-44b6-8666-9f8753238a2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040986 Mar 08 13:23:53.683457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 389/774] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:54.022481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:54.023081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:54.029058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:54.037972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:54.037972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:54.037972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:54.165282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:54.174225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:54.175708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:54.176883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-12c2dc70-09bc-4465-8c67-677970838e77 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158354 Mar 08 13:23:54.177434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 386/775] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:54.639582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a647b882-a6ff-4f30-960a-6be98dd75b7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:54.640490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a647b882-a6ff-4f30-960a-6be98dd75b7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:54.646390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a647b882-a6ff-4f30-960a-6be98dd75b7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:54.646952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a647b882-a6ff-4f30-960a-6be98dd75b7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:54.647592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a647b882-a6ff-4f30-960a-6be98dd75b7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:54.648030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a647b882-a6ff-4f30-960a-6be98dd75b7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:54.677747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a647b882-a6ff-4f30-960a-6be98dd75b7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Mar 08 13:23:54.678291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 390/776] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:54.694592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-79ded3e9-0580-4312-9fb5-b65b90fb119d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:54.695495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79ded3e9-0580-4312-9fb5-b65b90fb119d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:54.702285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ded3e9-0580-4312-9fb5-b65b90fb119d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:54.702730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ded3e9-0580-4312-9fb5-b65b90fb119d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:54.703485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ded3e9-0580-4312-9fb5-b65b90fb119d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:54.703915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ded3e9-0580-4312-9fb5-b65b90fb119d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:54.732611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-79ded3e9-0580-4312-9fb5-b65b90fb119d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041923 Mar 08 13:23:54.733183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 387/777] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:55.198548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:55.199149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:55.205520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:55.205968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:55.206947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:55.208879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:55.344413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:55.352568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:55.354777 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:55.355913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eecd6de2-fec8-4468-8f53-248bfcdfee47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162184 Mar 08 13:23:55.356460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 391/778] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:55.437571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:23:55.437773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:23:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:23:55.690429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-14908fd8-6435-4fa4-a782-a6c850d2fbbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:55.691251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-14908fd8-6435-4fa4-a782-a6c850d2fbbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:55.697662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14908fd8-6435-4fa4-a782-a6c850d2fbbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:55.698217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14908fd8-6435-4fa4-a782-a6c850d2fbbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:55.698916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14908fd8-6435-4fa4-a782-a6c850d2fbbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:55.699420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14908fd8-6435-4fa4-a782-a6c850d2fbbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:55.728416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-14908fd8-6435-4fa4-a782-a6c850d2fbbf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041694 Mar 08 13:23:55.728924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 388/779] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:55.743199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dfb4e7b4-207c-4d04-b2d4-6ba168d97335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:55.744344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dfb4e7b4-207c-4d04-b2d4-6ba168d97335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:55.750808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7b4-207c-4d04-b2d4-6ba168d97335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:55.751251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7b4-207c-4d04-b2d4-6ba168d97335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:55.752003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7b4-207c-4d04-b2d4-6ba168d97335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:55.752429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7b4-207c-4d04-b2d4-6ba168d97335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:55.785439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dfb4e7b4-207c-4d04-b2d4-6ba168d97335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Mar 08 13:23:55.785999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 392/780] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:56.375530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:56.376290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:56.382708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:56.383178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:56.384010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:56.384469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:56.514155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:56.522226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:56.523724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:56.525622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6c9c8bdf-6bbf-49cf-b5f3-a93d0b7334a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153564 Mar 08 13:23:56.526186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 389/781] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:56.740124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c086f8c3-dab8-439c-879a-37600ac709b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:56.740977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c086f8c3-dab8-439c-879a-37600ac709b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:56.746973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c086f8c3-dab8-439c-879a-37600ac709b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:56.747519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c086f8c3-dab8-439c-879a-37600ac709b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:56.750500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c086f8c3-dab8-439c-879a-37600ac709b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:56.750500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c086f8c3-dab8-439c-879a-37600ac709b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:56.777352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c086f8c3-dab8-439c-879a-37600ac709b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040958 Mar 08 13:23:56.779228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 393/782] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:56.798154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bf6e191a-79b9-40f1-bf02-78a8c5bae45b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:56.802208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bf6e191a-79b9-40f1-bf02-78a8c5bae45b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:56.805579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf6e191a-79b9-40f1-bf02-78a8c5bae45b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:56.806053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf6e191a-79b9-40f1-bf02-78a8c5bae45b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:56.806862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf6e191a-79b9-40f1-bf02-78a8c5bae45b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:56.807331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf6e191a-79b9-40f1-bf02-78a8c5bae45b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:56.835300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bf6e191a-79b9-40f1-bf02-78a8c5bae45b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041404 Mar 08 13:23:56.836582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 390/783] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:57.543715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:57.544247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:57.550101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:57.550544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:57.551296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:57.551725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:57.682116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:57.690292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:57.691782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:57.692938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-89f199cb-936a-44e3-b358-20f4be8709e6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153804 Mar 08 13:23:57.693485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 394/784] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:57.789378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-474bf846-b460-458f-94fa-c43843474b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:57.790373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-474bf846-b460-458f-94fa-c43843474b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:57.797179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-474bf846-b460-458f-94fa-c43843474b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:57.797642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-474bf846-b460-458f-94fa-c43843474b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:57.798578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-474bf846-b460-458f-94fa-c43843474b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:57.799125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-474bf846-b460-458f-94fa-c43843474b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:57.832431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-474bf846-b460-458f-94fa-c43843474b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047459 Mar 08 13:23:57.833023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 391/785] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:57.847397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5ba0ba4c-eb66-49b1-9e2d-86510468af5b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:57.848354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5ba0ba4c-eb66-49b1-9e2d-86510468af5b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:57.854875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ba0ba4c-eb66-49b1-9e2d-86510468af5b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:57.855319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ba0ba4c-eb66-49b1-9e2d-86510468af5b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:57.856072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ba0ba4c-eb66-49b1-9e2d-86510468af5b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:57.856499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ba0ba4c-eb66-49b1-9e2d-86510468af5b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:57.884891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5ba0ba4c-eb66-49b1-9e2d-86510468af5b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040833 Mar 08 13:23:57.885431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 395/786] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:58.711207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:58.711815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:58.718449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:58.718898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:58.719661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:58.720102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:58.844971 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7196cb5d-56c1-4e10-961c-0d883c6b9e31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:58.846029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7196cb5d-56c1-4e10-961c-0d883c6b9e31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:58.849498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:58.852416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7196cb5d-56c1-4e10-961c-0d883c6b9e31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:58.852893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7196cb5d-56c1-4e10-961c-0d883c6b9e31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:58.854022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7196cb5d-56c1-4e10-961c-0d883c6b9e31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:58.854457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7196cb5d-56c1-4e10-961c-0d883c6b9e31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:58.858153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:58.859667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:23:58.860848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-85e47394-ec29-49b4-b7ca-468429f4dc17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153480 Mar 08 13:23:58.861402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 392/787] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:23:58.883672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7196cb5d-56c1-4e10-961c-0d883c6b9e31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Mar 08 13:23:58.884986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 396/788] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:23:58.895276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e8e22c71-635e-4307-bc33-3e2f9f9f507d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:58.896177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e8e22c71-635e-4307-bc33-3e2f9f9f507d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:58.902130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8e22c71-635e-4307-bc33-3e2f9f9f507d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:58.902572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8e22c71-635e-4307-bc33-3e2f9f9f507d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:58.903320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8e22c71-635e-4307-bc33-3e2f9f9f507d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:58.903747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e8e22c71-635e-4307-bc33-3e2f9f9f507d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:58.934801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e8e22c71-635e-4307-bc33-3e2f9f9f507d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 Mar 08 13:23:58.935355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 393/789] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:23:59.879801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:59.880405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:59.886986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:59.887431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:59.888182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:59.888613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:59.895442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3442fec2-0208-434a-a1ed-762b60f75ab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:23:59.896355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3442fec2-0208-434a-a1ed-762b60f75ab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:23:59.905040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3442fec2-0208-434a-a1ed-762b60f75ab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:59.905500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3442fec2-0208-434a-a1ed-762b60f75ab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:59.906280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3442fec2-0208-434a-a1ed-762b60f75ab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:23:59.906722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3442fec2-0208-434a-a1ed-762b60f75ab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:23:59.936846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3442fec2-0208-434a-a1ed-762b60f75ab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045362 Mar 08 13:23:59.937480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 394/790] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:00.028887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:00.037527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:00.039036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:00.040306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b975991d-75a6-41d2-9279-eb92850872e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.164713 Mar 08 13:24:00.041041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 397/791] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:23:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:00.047207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2484404d-3695-4e36-aa74-40627c71322c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:00.048202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2484404d-3695-4e36-aa74-40627c71322c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:00.054131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2484404d-3695-4e36-aa74-40627c71322c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:00.054581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2484404d-3695-4e36-aa74-40627c71322c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:00.055350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2484404d-3695-4e36-aa74-40627c71322c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:00.055787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2484404d-3695-4e36-aa74-40627c71322c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:00.083458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2484404d-3695-4e36-aa74-40627c71322c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141161 Mar 08 13:24:00.084001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 395/792] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:23:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:00.948771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d30b2cc7-0d0f-4b7a-b419-9017c1cecf8e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:00.949678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d30b2cc7-0d0f-4b7a-b419-9017c1cecf8e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:00.955804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d30b2cc7-0d0f-4b7a-b419-9017c1cecf8e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:00.956249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d30b2cc7-0d0f-4b7a-b419-9017c1cecf8e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:00.957033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d30b2cc7-0d0f-4b7a-b419-9017c1cecf8e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:00.957466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d30b2cc7-0d0f-4b7a-b419-9017c1cecf8e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:00.985188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d30b2cc7-0d0f-4b7a-b419-9017c1cecf8e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040520 Mar 08 13:24:00.985711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 398/793] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:01.058829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:01.059441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:01.065822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:01.066277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:01.067038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:01.067474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:01.094930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3664dd1c-d33e-4c8e-b72d-a832246bd39b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:01.095823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3664dd1c-d33e-4c8e-b72d-a832246bd39b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:01.101650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3664dd1c-d33e-4c8e-b72d-a832246bd39b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:01.102095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3664dd1c-d33e-4c8e-b72d-a832246bd39b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:01.102854 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3664dd1c-d33e-4c8e-b72d-a832246bd39b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:01.103933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3664dd1c-d33e-4c8e-b72d-a832246bd39b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:01.133502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3664dd1c-d33e-4c8e-b72d-a832246bd39b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 Mar 08 13:24:01.134057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 399/794] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:01.200357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:01.208421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:01.209945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:01.211092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d10f0261-4286-4948-a2f1-6e52cb4c6ebf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156686 Mar 08 13:24:01.211645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 396/795] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:02.094438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d2e903b2-8db2-4cd6-93c1-ef5cf2e0a3b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:02.095420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2e903b2-8db2-4cd6-93c1-ef5cf2e0a3b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:02.101372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e903b2-8db2-4cd6-93c1-ef5cf2e0a3b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:02.106416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e903b2-8db2-4cd6-93c1-ef5cf2e0a3b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:02.106416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e903b2-8db2-4cd6-93c1-ef5cf2e0a3b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:02.106416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2e903b2-8db2-4cd6-93c1-ef5cf2e0a3b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:02.131403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d2e903b2-8db2-4cd6-93c1-ef5cf2e0a3b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138836 Mar 08 13:24:02.131939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 400/796] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:02.144144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-883e476d-e890-44d7-986a-a3989b60c9a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:02.145156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-883e476d-e890-44d7-986a-a3989b60c9a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:02.151947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-883e476d-e890-44d7-986a-a3989b60c9a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:02.152397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-883e476d-e890-44d7-986a-a3989b60c9a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:02.153187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-883e476d-e890-44d7-986a-a3989b60c9a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:02.153622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-883e476d-e890-44d7-986a-a3989b60c9a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:02.181391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-883e476d-e890-44d7-986a-a3989b60c9a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Mar 08 13:24:02.182074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 397/797] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:02.228747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:02.229344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:02.235181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:02.235623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:02.236379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:02.236839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:02.380514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:02.389033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:02.390535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:02.391677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-970af2a1-414c-423d-98c2-d9b293be25ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.166756 Mar 08 13:24:02.392230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 401/798] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:03.143545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a8a86f2-9453-4fcf-aef8-36ff5165fa83 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:03.144445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a8a86f2-9453-4fcf-aef8-36ff5165fa83 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:03.151412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a8a86f2-9453-4fcf-aef8-36ff5165fa83 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:03.151852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a8a86f2-9453-4fcf-aef8-36ff5165fa83 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:03.152615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a8a86f2-9453-4fcf-aef8-36ff5165fa83 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:03.153076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a8a86f2-9453-4fcf-aef8-36ff5165fa83 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:03.180820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a8a86f2-9453-4fcf-aef8-36ff5165fa83 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041227 Mar 08 13:24:03.181368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 398/799] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:03.192912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2f1dfff7-a8b8-4fdf-a0d2-a27baa3a9900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:03.194390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2f1dfff7-a8b8-4fdf-a0d2-a27baa3a9900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:03.201237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f1dfff7-a8b8-4fdf-a0d2-a27baa3a9900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:03.201680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f1dfff7-a8b8-4fdf-a0d2-a27baa3a9900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:03.202430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f1dfff7-a8b8-4fdf-a0d2-a27baa3a9900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:03.202858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f1dfff7-a8b8-4fdf-a0d2-a27baa3a9900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:03.231153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2f1dfff7-a8b8-4fdf-a0d2-a27baa3a9900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 Mar 08 13:24:03.231688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 402/800] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:03.410018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:03.410552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:03.416448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:03.416927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:03.417800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:03.418252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:03.548948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:03.560074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:03.561793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:03.563190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-479bbab8-14ef-49f9-be93-3a83564b346e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157009 Mar 08 13:24:03.563749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 399/801] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:04.192579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-04712ac9-1a8e-486d-a282-1cfee1b98178 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:04.193545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-04712ac9-1a8e-486d-a282-1cfee1b98178 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:04.201288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04712ac9-1a8e-486d-a282-1cfee1b98178 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:04.202065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04712ac9-1a8e-486d-a282-1cfee1b98178 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:04.203335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04712ac9-1a8e-486d-a282-1cfee1b98178 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:04.204082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04712ac9-1a8e-486d-a282-1cfee1b98178 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:04.236069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-04712ac9-1a8e-486d-a282-1cfee1b98178 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047576 Mar 08 13:24:04.236640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 403/802] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:04.242983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3e73f01c-f814-415e-8111-0087b0ae9221 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:04.243909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3e73f01c-f814-415e-8111-0087b0ae9221 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:04.250859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e73f01c-f814-415e-8111-0087b0ae9221 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:04.251312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e73f01c-f814-415e-8111-0087b0ae9221 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:04.252094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e73f01c-f814-415e-8111-0087b0ae9221 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:04.252569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e73f01c-f814-415e-8111-0087b0ae9221 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:04.285989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3e73f01c-f814-415e-8111-0087b0ae9221 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047181 Mar 08 13:24:04.286559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 400/803] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:04.710742 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:04.711874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:04.727461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:04.727921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:04.728725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:04.729167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:04.875205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:04.883524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:04.885183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:04.886894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fb1d2b93-9669-4cd5-9eff-baf9fda97127 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.303555 Mar 08 13:24:04.887447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 404/804] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:05.248929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fd9507ae-0c0b-4508-bc22-b172e40321c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:05.249832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fd9507ae-0c0b-4508-bc22-b172e40321c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:05.255946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd9507ae-0c0b-4508-bc22-b172e40321c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:05.256398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd9507ae-0c0b-4508-bc22-b172e40321c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:05.257187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd9507ae-0c0b-4508-bc22-b172e40321c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:05.257622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd9507ae-0c0b-4508-bc22-b172e40321c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:05.286151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fd9507ae-0c0b-4508-bc22-b172e40321c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 Mar 08 13:24:05.286718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 401/805] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:05.305201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-10efbf27-9443-4b03-87f6-a12cd54bd68c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:05.305938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-10efbf27-9443-4b03-87f6-a12cd54bd68c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:05.313822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10efbf27-9443-4b03-87f6-a12cd54bd68c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:05.314274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10efbf27-9443-4b03-87f6-a12cd54bd68c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:05.315344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10efbf27-9443-4b03-87f6-a12cd54bd68c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:05.315864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10efbf27-9443-4b03-87f6-a12cd54bd68c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:05.345979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-10efbf27-9443-4b03-87f6-a12cd54bd68c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Mar 08 13:24:05.347900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 405/806] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:05.905583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:05.906189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:05.912147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:05.912594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:05.913399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:05.913840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:06.049591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:06.058404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:06.059926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:06.061119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d25bdc4-c46e-4cab-8a50-9e748091280f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159441 Mar 08 13:24:06.061672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 402/807] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:06.298590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d093e455-e01e-43bc-b4d2-8e66b2851768 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:06.299647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d093e455-e01e-43bc-b4d2-8e66b2851768 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:06.306241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d093e455-e01e-43bc-b4d2-8e66b2851768 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:06.306769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d093e455-e01e-43bc-b4d2-8e66b2851768 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:06.307452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d093e455-e01e-43bc-b4d2-8e66b2851768 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:06.308475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d093e455-e01e-43bc-b4d2-8e66b2851768 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:06.343287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d093e455-e01e-43bc-b4d2-8e66b2851768 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049306 Mar 08 13:24:06.343951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 406/808] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:06.357660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-efd2053b-2297-406f-b26f-735629ff8deb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:06.358558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-efd2053b-2297-406f-b26f-735629ff8deb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:06.364859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd2053b-2297-406f-b26f-735629ff8deb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:06.365313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd2053b-2297-406f-b26f-735629ff8deb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:06.366132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd2053b-2297-406f-b26f-735629ff8deb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:06.366571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd2053b-2297-406f-b26f-735629ff8deb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:06.395510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-efd2053b-2297-406f-b26f-735629ff8deb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 Mar 08 13:24:06.396061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 403/809] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:06.731270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:24:06.731434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:24:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:24:07.079863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:07.080472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:07.086552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:07.087004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:07.087762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:07.088195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:07.222662 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:07.231270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:07.232774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:07.233917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3cbf34c4-3a05-47c1-ade1-aab2a3fc3a0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158039 Mar 08 13:24:07.234483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 407/810] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:07 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:07.355022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-188bcf7e-78ad-46c2-815c-d87a561a4139 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:07.355964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-188bcf7e-78ad-46c2-815c-d87a561a4139 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:07.362642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-188bcf7e-78ad-46c2-815c-d87a561a4139 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:07.363237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-188bcf7e-78ad-46c2-815c-d87a561a4139 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:07.363860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-188bcf7e-78ad-46c2-815c-d87a561a4139 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:07.364297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-188bcf7e-78ad-46c2-815c-d87a561a4139 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:07.394392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-188bcf7e-78ad-46c2-815c-d87a561a4139 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Mar 08 13:24:07.394939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 404/811] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:07.406232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f0a9908f-761c-403e-a7f6-c8190123e36e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:07.407197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f0a9908f-761c-403e-a7f6-c8190123e36e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:07.413475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0a9908f-761c-403e-a7f6-c8190123e36e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:07.413926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0a9908f-761c-403e-a7f6-c8190123e36e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:07.414689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0a9908f-761c-403e-a7f6-c8190123e36e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:07.415126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0a9908f-761c-403e-a7f6-c8190123e36e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:07.444015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f0a9908f-761c-403e-a7f6-c8190123e36e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 Mar 08 13:24:07.444544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 408/812] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:08.253652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:08.254342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:08.260846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:08.261636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:08.262410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:08.262844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:08.405707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:08.406793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5df90e2a-7c16-436b-ad8a-941509587c2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:08.407976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5df90e2a-7c16-436b-ad8a-941509587c2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:08.414159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5df90e2a-7c16-436b-ad8a-941509587c2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:08.414330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:08.414653 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5df90e2a-7c16-436b-ad8a-941509587c2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:08.415365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5df90e2a-7c16-436b-ad8a-941509587c2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:08.415869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5df90e2a-7c16-436b-ad8a-941509587c2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:08.415986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:08.417121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-084ebf0f-3c7e-47dc-8e97-7034c19037d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.169411 Mar 08 13:24:08.417733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 405/813] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:08.444624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5df90e2a-7c16-436b-ad8a-941509587c2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 Mar 08 13:24:08.445178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 409/814] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:08.455648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1418b0d3-a0f9-4965-9714-3657bd9f847b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:08.456546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1418b0d3-a0f9-4965-9714-3657bd9f847b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:08.462350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1418b0d3-a0f9-4965-9714-3657bd9f847b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:08.462794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1418b0d3-a0f9-4965-9714-3657bd9f847b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:08.463547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1418b0d3-a0f9-4965-9714-3657bd9f847b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:08.463985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1418b0d3-a0f9-4965-9714-3657bd9f847b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:08.492440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1418b0d3-a0f9-4965-9714-3657bd9f847b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040668 Mar 08 13:24:08.493033 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 406/815] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:09.436004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:09.436605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:09.442862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:09.443314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:09.444078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:09.444515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:09.456109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aa80766b-d929-41dc-b08e-ecf8fa084082 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:09.457096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aa80766b-d929-41dc-b08e-ecf8fa084082 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:09.463237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa80766b-d929-41dc-b08e-ecf8fa084082 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:09.463694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa80766b-d929-41dc-b08e-ecf8fa084082 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:09.464464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa80766b-d929-41dc-b08e-ecf8fa084082 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:09.464929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa80766b-d929-41dc-b08e-ecf8fa084082 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:09.493421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aa80766b-d929-41dc-b08e-ecf8fa084082 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041234 Mar 08 13:24:09.493978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 407/816] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:09.504888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b3799a6e-3e77-4b47-8277-0ff53bb8cb8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:09.505789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b3799a6e-3e77-4b47-8277-0ff53bb8cb8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:09.511455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3799a6e-3e77-4b47-8277-0ff53bb8cb8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:09.511920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3799a6e-3e77-4b47-8277-0ff53bb8cb8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:09.512713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3799a6e-3e77-4b47-8277-0ff53bb8cb8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:09.513802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3799a6e-3e77-4b47-8277-0ff53bb8cb8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:09.541785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b3799a6e-3e77-4b47-8277-0ff53bb8cb8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040543 Mar 08 13:24:09.542349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 408/817] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:09.580034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:09.592992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:09.595421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:09.597220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cbcb66ec-1914-4697-8939-0ac7ba32eb5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.165575 Mar 08 13:24:09.598039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 410/818] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:10.505446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dccf7039-be84-4eca-974e-77b58d343640 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:10.506351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dccf7039-be84-4eca-974e-77b58d343640 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:10.512571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dccf7039-be84-4eca-974e-77b58d343640 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:10.513048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dccf7039-be84-4eca-974e-77b58d343640 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:10.513811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dccf7039-be84-4eca-974e-77b58d343640 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:10.514244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dccf7039-be84-4eca-974e-77b58d343640 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:10.541527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dccf7039-be84-4eca-974e-77b58d343640 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040054 Mar 08 13:24:10.542073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 409/819] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:10.552415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6563e219-103c-48e2-bb37-39f8c31bf0b8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:10.553354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6563e219-103c-48e2-bb37-39f8c31bf0b8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:10.559465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6563e219-103c-48e2-bb37-39f8c31bf0b8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:10.560044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6563e219-103c-48e2-bb37-39f8c31bf0b8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:10.561423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6563e219-103c-48e2-bb37-39f8c31bf0b8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:10.561853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6563e219-103c-48e2-bb37-39f8c31bf0b8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:10.591246 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6563e219-103c-48e2-bb37-39f8c31bf0b8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Mar 08 13:24:10.591794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 411/820] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:10.621569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:10.622351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:10.631222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:10.631677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:10.632480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:10.632953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:10.766976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:10.775136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:10.776628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:10.777804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2d2ec58b-b6de-4c28-9e7f-2bf34daba649 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160242 Mar 08 13:24:10.778358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 410/821] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:10 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:11.553460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4d7897c1-a590-45a8-b7d1-e6a1c8619bea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:11.554363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4d7897c1-a590-45a8-b7d1-e6a1c8619bea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:11.560519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4d7897c1-a590-45a8-b7d1-e6a1c8619bea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:11.561730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4d7897c1-a590-45a8-b7d1-e6a1c8619bea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:11.562492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4d7897c1-a590-45a8-b7d1-e6a1c8619bea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:11.562923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4d7897c1-a590-45a8-b7d1-e6a1c8619bea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:11.591196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4d7897c1-a590-45a8-b7d1-e6a1c8619bea tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041637 Mar 08 13:24:11.591743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 412/822] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:11.603286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1f5fd963-679f-4f27-bdcf-011ba4793469 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:11.604163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1f5fd963-679f-4f27-bdcf-011ba4793469 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:11.611289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f5fd963-679f-4f27-bdcf-011ba4793469 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:11.611734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f5fd963-679f-4f27-bdcf-011ba4793469 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:11.612490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f5fd963-679f-4f27-bdcf-011ba4793469 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:11.612958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f5fd963-679f-4f27-bdcf-011ba4793469 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:11.643764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1f5fd963-679f-4f27-bdcf-011ba4793469 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Mar 08 13:24:11.644300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 411/823] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:11.796727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:11.797337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:11.803294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:11.803741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:11.804498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:11.804965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:11.938265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:11.946599 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:11.948153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:11.949331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-211ecccb-8c9b-44a4-abc4-289755e5920d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156851 Mar 08 13:24:11.949876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 413/824] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:12.603035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a2c2c24-49df-4b1d-b458-1b774616aabf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:12.603866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a2c2c24-49df-4b1d-b458-1b774616aabf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:12.610261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c24-49df-4b1d-b458-1b774616aabf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:12.610707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c24-49df-4b1d-b458-1b774616aabf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:12.611469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c24-49df-4b1d-b458-1b774616aabf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:12.611905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a2c2c24-49df-4b1d-b458-1b774616aabf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:12.639321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a2c2c24-49df-4b1d-b458-1b774616aabf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040341 Mar 08 13:24:12.640365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 412/825] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:12.655194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ba683fdd-eb51-4eda-8551-cf6e1796de7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:12.660615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ba683fdd-eb51-4eda-8551-cf6e1796de7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:12.663173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba683fdd-eb51-4eda-8551-cf6e1796de7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:12.663618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba683fdd-eb51-4eda-8551-cf6e1796de7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:12.664379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba683fdd-eb51-4eda-8551-cf6e1796de7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:12.664843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba683fdd-eb51-4eda-8551-cf6e1796de7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:12.692517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ba683fdd-eb51-4eda-8551-cf6e1796de7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041274 Mar 08 13:24:12.706370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 414/826] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:12.967086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:12.967694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:12.974117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:12.974613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:12.975335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:12.975773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:13.111715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:13.120541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:13.122558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:13.123777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-679db83a-4851-4ebd-86e9-d1764c64eec1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160574 Mar 08 13:24:13.124327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 413/827] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:13.651637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6737c6c6-c10d-4dac-a3b9-6b3dbf6649a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:13.652465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6737c6c6-c10d-4dac-a3b9-6b3dbf6649a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:13.659070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6737c6c6-c10d-4dac-a3b9-6b3dbf6649a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:13.659639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6737c6c6-c10d-4dac-a3b9-6b3dbf6649a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:13.660258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6737c6c6-c10d-4dac-a3b9-6b3dbf6649a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:13.660714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6737c6c6-c10d-4dac-a3b9-6b3dbf6649a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:13.689292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6737c6c6-c10d-4dac-a3b9-6b3dbf6649a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041745 Mar 08 13:24:13.689831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 415/828] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:13.703203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-88a771c6-b840-4ef1-af7d-bb6421253d85 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:13.704787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-88a771c6-b840-4ef1-af7d-bb6421253d85 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:13.711079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88a771c6-b840-4ef1-af7d-bb6421253d85 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:13.711547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88a771c6-b840-4ef1-af7d-bb6421253d85 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:13.712286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88a771c6-b840-4ef1-af7d-bb6421253d85 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:13.712749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88a771c6-b840-4ef1-af7d-bb6421253d85 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:13.740150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-88a771c6-b840-4ef1-af7d-bb6421253d85 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040787 Mar 08 13:24:13.740710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 414/829] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:14.142457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:14.143057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:14.149151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:14.149593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:14.150349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:14.150780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:14.286121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:14.294295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:14.295801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:14.296971 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6c469e39-6ddd-4626-b1eb-dc781f81932d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158419 Mar 08 13:24:14.298575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 416/830] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:14 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:14.701051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8f140772-ed76-4c84-a060-b0157618670d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:14.701945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8f140772-ed76-4c84-a060-b0157618670d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:14.707853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f140772-ed76-4c84-a060-b0157618670d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:14.708394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f140772-ed76-4c84-a060-b0157618670d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:14.709058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f140772-ed76-4c84-a060-b0157618670d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:14.709499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f140772-ed76-4c84-a060-b0157618670d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:14.737573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8f140772-ed76-4c84-a060-b0157618670d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040548 Mar 08 13:24:14.738105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 415/831] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:14.751739 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c10ea2a2-463b-4f87-9b5b-d97d08d77885 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:14.752649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c10ea2a2-463b-4f87-9b5b-d97d08d77885 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:14.758823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c10ea2a2-463b-4f87-9b5b-d97d08d77885 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:14.759271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c10ea2a2-463b-4f87-9b5b-d97d08d77885 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:14.760039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c10ea2a2-463b-4f87-9b5b-d97d08d77885 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:14.760474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c10ea2a2-463b-4f87-9b5b-d97d08d77885 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:14.788589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c10ea2a2-463b-4f87-9b5b-d97d08d77885 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041259 Mar 08 13:24:14.789156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 417/832] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:15.315849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:15.316404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:15.322982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:15.323406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:15.324222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:15.324676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:15.457462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:15.465437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:15.466913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:15.468055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9da975ff-5366-4de1-a721-525bc6e79abb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156665 Mar 08 13:24:15.468612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 416/833] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:15.749494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ece19c3c-626e-4077-bdee-9f41b949a3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:15.751296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ece19c3c-626e-4077-bdee-9f41b949a3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:15.757736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ece19c3c-626e-4077-bdee-9f41b949a3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:15.758292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ece19c3c-626e-4077-bdee-9f41b949a3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:15.758929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ece19c3c-626e-4077-bdee-9f41b949a3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:15.759371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ece19c3c-626e-4077-bdee-9f41b949a3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:15.786694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ece19c3c-626e-4077-bdee-9f41b949a3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041428 Mar 08 13:24:15.787236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 418/834] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:15.799854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3d6564a4-7964-41a8-aacf-c387adc3b24f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:15.800786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3d6564a4-7964-41a8-aacf-c387adc3b24f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:15.807043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6564a4-7964-41a8-aacf-c387adc3b24f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:15.807488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6564a4-7964-41a8-aacf-c387adc3b24f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:15.808237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6564a4-7964-41a8-aacf-c387adc3b24f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:15.808682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6564a4-7964-41a8-aacf-c387adc3b24f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:15.837003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3d6564a4-7964-41a8-aacf-c387adc3b24f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041588 Mar 08 13:24:15.837548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 417/835] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:16.486602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:16.487194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:16.493187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:16.493632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:16.494387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:16.494817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:16.623640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:16.631891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:16.633445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:16.634590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e05141fb-37f0-450f-be28-92f201032842 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151893 Mar 08 13:24:16.635145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 419/836] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:16.798346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b648f9fa-aeb2-472c-92d3-ea3763af79db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:16.799232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b648f9fa-aeb2-472c-92d3-ea3763af79db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:16.805309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b648f9fa-aeb2-472c-92d3-ea3763af79db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:16.805914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b648f9fa-aeb2-472c-92d3-ea3763af79db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:16.806490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b648f9fa-aeb2-472c-92d3-ea3763af79db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:16.806916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b648f9fa-aeb2-472c-92d3-ea3763af79db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:16.835126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b648f9fa-aeb2-472c-92d3-ea3763af79db tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040753 Mar 08 13:24:16.838020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 418/837] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:16.848834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3f55b79b-b042-4bef-bd5d-72822b21065d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:16.849749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3f55b79b-b042-4bef-bd5d-72822b21065d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:16.855933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3f55b79b-b042-4bef-bd5d-72822b21065d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:16.856384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3f55b79b-b042-4bef-bd5d-72822b21065d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:16.857182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3f55b79b-b042-4bef-bd5d-72822b21065d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:16.857623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3f55b79b-b042-4bef-bd5d-72822b21065d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:16.889566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3f55b79b-b042-4bef-bd5d-72822b21065d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Mar 08 13:24:16.890036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 420/838] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:17.653231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:17.653830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:17.660131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:17.660577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:17.661354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:17.661789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:17.799107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:17.807568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:17.809074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:17.810206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9162cf9b-1928-46c6-8909-3bbb46254498 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160858 Mar 08 13:24:17.810756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 419/839] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:17.847033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-597e60fb-3d4e-4ebe-9c31-0f4339078f02 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:17.847969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-597e60fb-3d4e-4ebe-9c31-0f4339078f02 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:17.854344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-597e60fb-3d4e-4ebe-9c31-0f4339078f02 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:17.854974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-597e60fb-3d4e-4ebe-9c31-0f4339078f02 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:17.855540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-597e60fb-3d4e-4ebe-9c31-0f4339078f02 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:17.855973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-597e60fb-3d4e-4ebe-9c31-0f4339078f02 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:17.884801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-597e60fb-3d4e-4ebe-9c31-0f4339078f02 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Mar 08 13:24:17.885343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 421/840] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:17.901005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0ac4cee4-5908-4a9e-a591-62398500d962 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:17.901901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0ac4cee4-5908-4a9e-a591-62398500d962 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:17.907768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ac4cee4-5908-4a9e-a591-62398500d962 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:17.908242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ac4cee4-5908-4a9e-a591-62398500d962 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:17.908992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ac4cee4-5908-4a9e-a591-62398500d962 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:17.909422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0ac4cee4-5908-4a9e-a591-62398500d962 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:17.937604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0ac4cee4-5908-4a9e-a591-62398500d962 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040408 Mar 08 13:24:17.938847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 420/841] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:18.829620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:18.830317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:18.836237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:18.836779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:18.842259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:18.842259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:18.896995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f51d290c-9a53-4ac5-bb64-23eda454a8a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:18.897896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f51d290c-9a53-4ac5-bb64-23eda454a8a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:18.904052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f51d290c-9a53-4ac5-bb64-23eda454a8a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:18.904570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f51d290c-9a53-4ac5-bb64-23eda454a8a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:18.905370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f51d290c-9a53-4ac5-bb64-23eda454a8a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:18.905807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f51d290c-9a53-4ac5-bb64-23eda454a8a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:18.937798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f51d290c-9a53-4ac5-bb64-23eda454a8a8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Mar 08 13:24:18.939080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 421/842] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:18.950414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cf465300-9c62-4bb9-a863-3c5847d37c4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:18.951187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cf465300-9c62-4bb9-a863-3c5847d37c4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:18.957032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf465300-9c62-4bb9-a863-3c5847d37c4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:18.957485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf465300-9c62-4bb9-a863-3c5847d37c4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:18.958283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf465300-9c62-4bb9-a863-3c5847d37c4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:18.958721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf465300-9c62-4bb9-a863-3c5847d37c4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:18.993569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cf465300-9c62-4bb9-a863-3c5847d37c4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047718 Mar 08 13:24:18.994133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 422/843] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:19.021013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:19.029898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:19.032567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:19.032795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c3c2255a-d53f-4958-9e02-d5ca913f1bec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.207628 Mar 08 13:24:19.033256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 422/844] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:19.950307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dc9f31af-eec7-4052-91b3-0d06b80b073f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:19.951204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dc9f31af-eec7-4052-91b3-0d06b80b073f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:19.958142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9f31af-eec7-4052-91b3-0d06b80b073f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:19.958570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9f31af-eec7-4052-91b3-0d06b80b073f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:19.959325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9f31af-eec7-4052-91b3-0d06b80b073f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:19.959756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9f31af-eec7-4052-91b3-0d06b80b073f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:19.988531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dc9f31af-eec7-4052-91b3-0d06b80b073f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Mar 08 13:24:19.989109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 423/845] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:20.006186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-96218f23-b905-481f-99cd-52e84fe8dfa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:20.007275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-96218f23-b905-481f-99cd-52e84fe8dfa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:20.013691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96218f23-b905-481f-99cd-52e84fe8dfa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:20.014141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96218f23-b905-481f-99cd-52e84fe8dfa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:20.014900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96218f23-b905-481f-99cd-52e84fe8dfa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:20.015385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96218f23-b905-481f-99cd-52e84fe8dfa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:20.043223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-96218f23-b905-481f-99cd-52e84fe8dfa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Mar 08 13:24:20.043839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 423/846] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:20.051811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:20.052457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:20.058648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:20.059094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:20.059860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:20.060296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:20.189827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:20.197856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:20.199365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:20.200512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2233f98c-9aef-4d33-b8bf-4a783afb390c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153445 Mar 08 13:24:20.201097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 424/847] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:21.000609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f0805807-4a00-4f51-b39c-faa3ed2e8969 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:21.001537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f0805807-4a00-4f51-b39c-faa3ed2e8969 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:21.007963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0805807-4a00-4f51-b39c-faa3ed2e8969 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:21.008411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0805807-4a00-4f51-b39c-faa3ed2e8969 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:21.009203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0805807-4a00-4f51-b39c-faa3ed2e8969 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:21.009632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0805807-4a00-4f51-b39c-faa3ed2e8969 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:21.037342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f0805807-4a00-4f51-b39c-faa3ed2e8969 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040900 Mar 08 13:24:21.037879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 424/848] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:21.055006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5658769b-5e78-4ee3-9ba1-0dd86d88594a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:21.055916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5658769b-5e78-4ee3-9ba1-0dd86d88594a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:21.062253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5658769b-5e78-4ee3-9ba1-0dd86d88594a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:21.062697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5658769b-5e78-4ee3-9ba1-0dd86d88594a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:21.063737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5658769b-5e78-4ee3-9ba1-0dd86d88594a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:21.064873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5658769b-5e78-4ee3-9ba1-0dd86d88594a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:21.095246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5658769b-5e78-4ee3-9ba1-0dd86d88594a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Mar 08 13:24:21.095893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 425/849] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:21.219145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:21.219753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:21.226128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:21.226575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:21.227337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:21.227773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:21.357775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:21.366597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:21.368099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:21.369282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d466f405-89ec-4550-871f-de474cd602be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154027 Mar 08 13:24:21.369828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 425/850] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:22.049951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f3affa47-0048-4cdd-ac4b-ee4ec610668b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:22.051003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f3affa47-0048-4cdd-ac4b-ee4ec610668b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:22.057063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3affa47-0048-4cdd-ac4b-ee4ec610668b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:22.057647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3affa47-0048-4cdd-ac4b-ee4ec610668b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:22.058280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3affa47-0048-4cdd-ac4b-ee4ec610668b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:22.058718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3affa47-0048-4cdd-ac4b-ee4ec610668b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:22.087353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f3affa47-0048-4cdd-ac4b-ee4ec610668b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042594 Mar 08 13:24:22.087911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 426/851] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:22.106800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d2d5a9d0-f5c8-4238-b403-b3fce6a194ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:22.107714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2d5a9d0-f5c8-4238-b403-b3fce6a194ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:22.114755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2d5a9d0-f5c8-4238-b403-b3fce6a194ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:22.115200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2d5a9d0-f5c8-4238-b403-b3fce6a194ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:22.115959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2d5a9d0-f5c8-4238-b403-b3fce6a194ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:22.116390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2d5a9d0-f5c8-4238-b403-b3fce6a194ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:22.144170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d2d5a9d0-f5c8-4238-b403-b3fce6a194ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041288 Mar 08 13:24:22.144645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 426/852] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:22.389009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:22.389653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:22.396877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:22.397262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:22.398037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:22.398476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:22.532403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:22.541619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:22.543098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:22.544238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0e8b2222-22ea-4b3a-ab82-6c4671ab5b16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159184 Mar 08 13:24:22.544803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 427/853] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:23.098686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c70c30ae-b7a1-44f7-826e-4593e1bc7e32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:23.099609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c70c30ae-b7a1-44f7-826e-4593e1bc7e32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:23.105444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c70c30ae-b7a1-44f7-826e-4593e1bc7e32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:23.105890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c70c30ae-b7a1-44f7-826e-4593e1bc7e32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:23.106644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c70c30ae-b7a1-44f7-826e-4593e1bc7e32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:23.107106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c70c30ae-b7a1-44f7-826e-4593e1bc7e32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:23.135466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c70c30ae-b7a1-44f7-826e-4593e1bc7e32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040875 Mar 08 13:24:23.136000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 427/854] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:23.161631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d71aa37-5b06-4f5f-a035-f90f8c46784d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:23.162607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d71aa37-5b06-4f5f-a035-f90f8c46784d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:23.168808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d71aa37-5b06-4f5f-a035-f90f8c46784d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:23.169254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d71aa37-5b06-4f5f-a035-f90f8c46784d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:23.170014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d71aa37-5b06-4f5f-a035-f90f8c46784d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:23.170444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d71aa37-5b06-4f5f-a035-f90f8c46784d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:23.199910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d71aa37-5b06-4f5f-a035-f90f8c46784d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048547 Mar 08 13:24:23.200449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 428/855] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:23.562857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:23.563453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:23.569278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:23.569722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:23.570472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:23.570897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:23.710624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:23.718789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:23.720276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:23.722065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-04d59ff7-41f4-42b2-9547-393c8f00f281 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163090 Mar 08 13:24:23.722614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 428/856] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:24.147513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4ef18c9f-36bf-4928-a6c8-ff354eecf25a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:24.148336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4ef18c9f-36bf-4928-a6c8-ff354eecf25a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:24.154174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ef18c9f-36bf-4928-a6c8-ff354eecf25a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:24.154623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ef18c9f-36bf-4928-a6c8-ff354eecf25a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:24.155386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ef18c9f-36bf-4928-a6c8-ff354eecf25a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:24.155823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ef18c9f-36bf-4928-a6c8-ff354eecf25a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:24.184022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4ef18c9f-36bf-4928-a6c8-ff354eecf25a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040492 Mar 08 13:24:24.184698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 429/857] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:24.211866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-05e4d068-a7e2-443b-8f1e-d084c1bb1b9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:24.212815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-05e4d068-a7e2-443b-8f1e-d084c1bb1b9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:24.219021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05e4d068-a7e2-443b-8f1e-d084c1bb1b9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:24.219473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05e4d068-a7e2-443b-8f1e-d084c1bb1b9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:24.220237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05e4d068-a7e2-443b-8f1e-d084c1bb1b9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:24.221323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-05e4d068-a7e2-443b-8f1e-d084c1bb1b9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:24.249158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-05e4d068-a7e2-443b-8f1e-d084c1bb1b9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Mar 08 13:24:24.249704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 429/858] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:24.739803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:24.740331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:24.746072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:24.746520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:24.747277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:24.747963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:24.875724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:24.884798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:24.886286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:24.887415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fba8f90e-9395-4b9f-a71f-c91925545a95 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152134 Mar 08 13:24:24.888128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 430/859] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:25.194977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1673e151-857e-4049-9fd3-d782d63327bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:25.195877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1673e151-857e-4049-9fd3-d782d63327bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:25.201770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1673e151-857e-4049-9fd3-d782d63327bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:25.202215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1673e151-857e-4049-9fd3-d782d63327bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:25.202966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1673e151-857e-4049-9fd3-d782d63327bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:25.203394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1673e151-857e-4049-9fd3-d782d63327bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:25.232078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1673e151-857e-4049-9fd3-d782d63327bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 Mar 08 13:24:25.232713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 430/860] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:25.260625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-349fabb3-2082-4f09-bdd7-ba56d221a097 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:25.261548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-349fabb3-2082-4f09-bdd7-ba56d221a097 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:25.267759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-349fabb3-2082-4f09-bdd7-ba56d221a097 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:25.268203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-349fabb3-2082-4f09-bdd7-ba56d221a097 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:25.268986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-349fabb3-2082-4f09-bdd7-ba56d221a097 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:25.269417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-349fabb3-2082-4f09-bdd7-ba56d221a097 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:25.297010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-349fabb3-2082-4f09-bdd7-ba56d221a097 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040213 Mar 08 13:24:25.297552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 431/861] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:25.906213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:25.906851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:25.912843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:25.913300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:25.914067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:25.914502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:26.051500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:26.059658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:26.061174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:26.062307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8d001319-55ce-465f-aa89-b1ff39e692db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160305 Mar 08 13:24:26.062858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 431/862] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:26.243482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-99ef0c88-00e5-430b-bb0f-37be60632cc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:26.244432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-99ef0c88-00e5-430b-bb0f-37be60632cc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:26.250521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99ef0c88-00e5-430b-bb0f-37be60632cc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:26.250968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99ef0c88-00e5-430b-bb0f-37be60632cc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:26.252437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99ef0c88-00e5-430b-bb0f-37be60632cc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:26.252915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99ef0c88-00e5-430b-bb0f-37be60632cc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:26.280720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-99ef0c88-00e5-430b-bb0f-37be60632cc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041133 Mar 08 13:24:26.281338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 432/863] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:26.310303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a228d5f-cf17-47fd-8148-12aff46a16da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:26.312411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6a228d5f-cf17-47fd-8148-12aff46a16da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:26.319670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a228d5f-cf17-47fd-8148-12aff46a16da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:26.320719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a228d5f-cf17-47fd-8148-12aff46a16da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:26.321510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a228d5f-cf17-47fd-8148-12aff46a16da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:26.321951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a228d5f-cf17-47fd-8148-12aff46a16da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:26.354709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a228d5f-cf17-47fd-8148-12aff46a16da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050165 Mar 08 13:24:26.355260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 432/864] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:27.081269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:27.081907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:27.087756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:27.088208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:27.089006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:27.089444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:27.219592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:27.227768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:27.229307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:27.230448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f83887dd-f633-45f5-ad20-916580958276 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153403 Mar 08 13:24:27.231001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 433/865] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:27.293206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b23b2d4b-15d7-4b3b-88a8-a96c4a6dc4ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:27.294122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b23b2d4b-15d7-4b3b-88a8-a96c4a6dc4ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:27.299920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b23b2d4b-15d7-4b3b-88a8-a96c4a6dc4ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:27.300363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b23b2d4b-15d7-4b3b-88a8-a96c4a6dc4ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:27.301170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b23b2d4b-15d7-4b3b-88a8-a96c4a6dc4ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:27.301592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b23b2d4b-15d7-4b3b-88a8-a96c4a6dc4ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:27.330150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b23b2d4b-15d7-4b3b-88a8-a96c4a6dc4ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Mar 08 13:24:27.331524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 433/866] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:27.366620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-583c0a11-2162-468b-a1f9-efdde9730c1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:27.367516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-583c0a11-2162-468b-a1f9-efdde9730c1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:27.374507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-583c0a11-2162-468b-a1f9-efdde9730c1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:27.374951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-583c0a11-2162-468b-a1f9-efdde9730c1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:27.375701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-583c0a11-2162-468b-a1f9-efdde9730c1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:27.376132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-583c0a11-2162-468b-a1f9-efdde9730c1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:27.406535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-583c0a11-2162-468b-a1f9-efdde9730c1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Mar 08 13:24:27.407075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 434/867] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:28.250107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:28.250703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:28.257084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:28.257553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:28.258314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:28.258743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:28.342519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-96acb9be-05a5-470b-98c5-6f425c66a674 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:28.343632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-96acb9be-05a5-470b-98c5-6f425c66a674 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:28.354235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96acb9be-05a5-470b-98c5-6f425c66a674 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:28.354235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96acb9be-05a5-470b-98c5-6f425c66a674 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:28.354235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96acb9be-05a5-470b-98c5-6f425c66a674 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:28.354235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-96acb9be-05a5-470b-98c5-6f425c66a674 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:28.382017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-96acb9be-05a5-470b-98c5-6f425c66a674 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043383 Mar 08 13:24:28.382911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 435/868] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:28.400846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:28.411127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:28.412743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:28.414311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0c5006de-4b2f-48e3-b983-6dd03b0d565d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.168504 Mar 08 13:24:28.415076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 434/869] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:28.418699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bc58e0ca-8336-436d-b521-e2bf8406ac1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:28.419637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bc58e0ca-8336-436d-b521-e2bf8406ac1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:28.426533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc58e0ca-8336-436d-b521-e2bf8406ac1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:28.426997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc58e0ca-8336-436d-b521-e2bf8406ac1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:28.427807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc58e0ca-8336-436d-b521-e2bf8406ac1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:28.428283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc58e0ca-8336-436d-b521-e2bf8406ac1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:28.457578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bc58e0ca-8336-436d-b521-e2bf8406ac1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043124 Mar 08 13:24:28.458134 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 436/870] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:29.395546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-72dff017-f2d3-44d0-8028-37b8b5d2e916 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:29.396498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-72dff017-f2d3-44d0-8028-37b8b5d2e916 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:29.404809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72dff017-f2d3-44d0-8028-37b8b5d2e916 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:29.405423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72dff017-f2d3-44d0-8028-37b8b5d2e916 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:29.406109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72dff017-f2d3-44d0-8028-37b8b5d2e916 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:29.406540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72dff017-f2d3-44d0-8028-37b8b5d2e916 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:29.432977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:29.433584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:29.439937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-72dff017-f2d3-44d0-8028-37b8b5d2e916 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049702 Mar 08 13:24:29.440700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:29.440840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 435/871] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:29.441062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:29.441830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:29.442263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:29.469091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b1a32f3-cb07-4797-a0d5-110000007a82 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:29.470000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8b1a32f3-cb07-4797-a0d5-110000007a82 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:29.476548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b1a32f3-cb07-4797-a0d5-110000007a82 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:29.477041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b1a32f3-cb07-4797-a0d5-110000007a82 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:29.477811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b1a32f3-cb07-4797-a0d5-110000007a82 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:29.478252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b1a32f3-cb07-4797-a0d5-110000007a82 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:29.508319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b1a32f3-cb07-4797-a0d5-110000007a82 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Mar 08 13:24:29.508926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 436/872] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:29.577556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:29.586222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:29.587715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:29.588885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fb024324-e1ed-4d12-a32b-ce614072f8a2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159848 Mar 08 13:24:29.589434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 437/873] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:30.451912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5003bb8f-1db4-49fb-a1f0-cf5af17c1d10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:30.452892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5003bb8f-1db4-49fb-a1f0-cf5af17c1d10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:30.459844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5003bb8f-1db4-49fb-a1f0-cf5af17c1d10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:30.460294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5003bb8f-1db4-49fb-a1f0-cf5af17c1d10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:30.461096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5003bb8f-1db4-49fb-a1f0-cf5af17c1d10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:30.461538 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5003bb8f-1db4-49fb-a1f0-cf5af17c1d10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:30.489132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5003bb8f-1db4-49fb-a1f0-cf5af17c1d10 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041301 Mar 08 13:24:30.489719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 437/874] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:30.520221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3e892701-cda7-43df-aa30-e2ce84bdb5df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:30.521159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3e892701-cda7-43df-aa30-e2ce84bdb5df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:30.527393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e892701-cda7-43df-aa30-e2ce84bdb5df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:30.527846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e892701-cda7-43df-aa30-e2ce84bdb5df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:30.528614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e892701-cda7-43df-aa30-e2ce84bdb5df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:30.529082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e892701-cda7-43df-aa30-e2ce84bdb5df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:30.557569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3e892701-cda7-43df-aa30-e2ce84bdb5df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Mar 08 13:24:30.558128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 438/875] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:30.607487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:30.608012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:30.614091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:30.614531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:30.615281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:30.615715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:30.749624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:30.757803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:30.759288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:30.760422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fb11d07e-3649-490c-82a7-9457efaf47ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156876 Mar 08 13:24:30.763080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 438/876] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:31.501414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2fa8dd25-a553-4193-bf00-b65005059390 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:31.503192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2fa8dd25-a553-4193-bf00-b65005059390 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:31.509226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fa8dd25-a553-4193-bf00-b65005059390 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:31.509677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fa8dd25-a553-4193-bf00-b65005059390 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:31.510456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fa8dd25-a553-4193-bf00-b65005059390 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:31.510891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fa8dd25-a553-4193-bf00-b65005059390 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:31.540459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2fa8dd25-a553-4193-bf00-b65005059390 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Mar 08 13:24:31.541168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 439/877] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:31.569603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a55e57cf-5482-4725-941b-3a1478c3f223 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:31.570571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a55e57cf-5482-4725-941b-3a1478c3f223 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:31.576782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a55e57cf-5482-4725-941b-3a1478c3f223 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:31.577229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a55e57cf-5482-4725-941b-3a1478c3f223 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:31.577997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a55e57cf-5482-4725-941b-3a1478c3f223 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:31.578431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a55e57cf-5482-4725-941b-3a1478c3f223 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:31.606205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a55e57cf-5482-4725-941b-3a1478c3f223 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041189 Mar 08 13:24:31.606676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 439/878] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:31.781262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:31.781858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:31.788235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:31.788697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:31.789465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:31.789898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:31.923781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:31.932648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:31.934162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:31.935305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3bef4a94-0912-44ba-8b30-05636c6faaa8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157914 Mar 08 13:24:31.935858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 440/879] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:32.552193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-00b88413-2c3f-4b9e-b8b8-453f22b44735 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:32.553291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-00b88413-2c3f-4b9e-b8b8-453f22b44735 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:32.559135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00b88413-2c3f-4b9e-b8b8-453f22b44735 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:32.559578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00b88413-2c3f-4b9e-b8b8-453f22b44735 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:32.560329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00b88413-2c3f-4b9e-b8b8-453f22b44735 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:32.560794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00b88413-2c3f-4b9e-b8b8-453f22b44735 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:32.589134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-00b88413-2c3f-4b9e-b8b8-453f22b44735 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Mar 08 13:24:32.589722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 440/880] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:32.617772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-15cfdc56-fcce-43c4-b199-8689e29c928f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:32.618599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-15cfdc56-fcce-43c4-b199-8689e29c928f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:32.625105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15cfdc56-fcce-43c4-b199-8689e29c928f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:32.625547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15cfdc56-fcce-43c4-b199-8689e29c928f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:32.626297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15cfdc56-fcce-43c4-b199-8689e29c928f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:32.626726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15cfdc56-fcce-43c4-b199-8689e29c928f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:32.655254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-15cfdc56-fcce-43c4-b199-8689e29c928f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041415 Mar 08 13:24:32.655817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 441/881] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:32.953402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:32.954006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:32.960302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:32.960786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:32.961554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:32.961995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:33.101186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:33.109318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:33.110798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:33.112119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e123a244-4631-42f5-be54-18f7d2d4fe7e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162382 Mar 08 13:24:33.112698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 441/882] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:32 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:33.600973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d99147c1-cdad-4e61-a5ed-775d6043b482 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:33.601789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d99147c1-cdad-4e61-a5ed-775d6043b482 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:33.608177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d99147c1-cdad-4e61-a5ed-775d6043b482 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:33.608623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d99147c1-cdad-4e61-a5ed-775d6043b482 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:33.609407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d99147c1-cdad-4e61-a5ed-775d6043b482 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:33.609836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d99147c1-cdad-4e61-a5ed-775d6043b482 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:33.639136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d99147c1-cdad-4e61-a5ed-775d6043b482 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 Mar 08 13:24:33.639764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 442/883] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:33.666919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0ae67295-1661-4937-a00f-b1043210815b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:33.667836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0ae67295-1661-4937-a00f-b1043210815b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:33.674666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ae67295-1661-4937-a00f-b1043210815b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:33.675298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ae67295-1661-4937-a00f-b1043210815b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:33.676096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ae67295-1661-4937-a00f-b1043210815b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:33.676534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ae67295-1661-4937-a00f-b1043210815b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:33.704558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0ae67295-1661-4937-a00f-b1043210815b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Mar 08 13:24:33.705128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 442/884] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:34.130551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:34.131151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:34.136905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:34.137346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:34.138095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:34.138525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:34.271500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:34.279518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:34.281032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:34.282172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e286053c-2304-42b2-8206-87756a9f9119 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156043 Mar 08 13:24:34.282723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 443/885] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:34 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:34.651416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-48c10bd9-5abd-4317-96f2-0c3b1c897bb3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:34.652244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-48c10bd9-5abd-4317-96f2-0c3b1c897bb3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:34.658152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48c10bd9-5abd-4317-96f2-0c3b1c897bb3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:34.658817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48c10bd9-5abd-4317-96f2-0c3b1c897bb3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:34.660132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48c10bd9-5abd-4317-96f2-0c3b1c897bb3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:34.660599 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-48c10bd9-5abd-4317-96f2-0c3b1c897bb3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:34.694111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-48c10bd9-5abd-4317-96f2-0c3b1c897bb3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Mar 08 13:24:34.694914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 443/886] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:34.715582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-db0f3234-5f90-4731-af5f-b7b053866fdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:34.716798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-db0f3234-5f90-4731-af5f-b7b053866fdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:34.723512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db0f3234-5f90-4731-af5f-b7b053866fdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:34.723957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db0f3234-5f90-4731-af5f-b7b053866fdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:34.724755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db0f3234-5f90-4731-af5f-b7b053866fdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:34.725188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db0f3234-5f90-4731-af5f-b7b053866fdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:34.753037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-db0f3234-5f90-4731-af5f-b7b053866fdd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041469 Mar 08 13:24:34.753573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 444/887] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:35.301348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:35.301875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:35.307748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:35.308199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:35.308987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:35.309425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:35.444903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:35.453075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:35.454575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:35.456104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fdc6d455-1853-4513-96fc-27bac427dc44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159245 Mar 08 13:24:35.456675 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 444/888] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:35.707207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c158c8ee-5735-4a17-8d2f-5a513f0a831e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:35.708172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c158c8ee-5735-4a17-8d2f-5a513f0a831e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:35.714149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c158c8ee-5735-4a17-8d2f-5a513f0a831e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:35.714596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c158c8ee-5735-4a17-8d2f-5a513f0a831e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:35.715354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c158c8ee-5735-4a17-8d2f-5a513f0a831e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:35.715790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c158c8ee-5735-4a17-8d2f-5a513f0a831e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:35.748629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c158c8ee-5735-4a17-8d2f-5a513f0a831e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Mar 08 13:24:35.749216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 445/889] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:35.764549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-572452a6-e8d7-4ef7-8fd9-f58c8aab9059 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:35.765563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-572452a6-e8d7-4ef7-8fd9-f58c8aab9059 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:35.771873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572452a6-e8d7-4ef7-8fd9-f58c8aab9059 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:35.772324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572452a6-e8d7-4ef7-8fd9-f58c8aab9059 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:35.773117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572452a6-e8d7-4ef7-8fd9-f58c8aab9059 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:35.773554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-572452a6-e8d7-4ef7-8fd9-f58c8aab9059 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:35.803640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-572452a6-e8d7-4ef7-8fd9-f58c8aab9059 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043004 Mar 08 13:24:35.804208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 445/890] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:36.464802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:36.465295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:36.472231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.472696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.473468 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.473897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.474756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:36.475366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:36.481627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.482076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.482838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.483276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.499254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:24:36.616512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:36.624905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:36.626393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:36.627537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cd64bcc1-5b16-4da4-8238-b10acd529c99 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157345 Mar 08 13:24:36.628404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 446/891] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:36.749049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a55ce5b-bf6e-4634-ae6c-b31731c11f70 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 204 len: 0 microversion: 2.1 time: 0.287829 Mar 08 13:24:36.749662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 446/892] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:24:36 2022] DELETE /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:24:36.758359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:36.759266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:36.760224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4e992bb2-9b69-44fe-9642-e950eb1a5730 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:36.761229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4e992bb2-9b69-44fe-9642-e950eb1a5730 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:36.765731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.766250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.766854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e992bb2-9b69-44fe-9642-e950eb1a5730 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.767023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.767303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e992bb2-9b69-44fe-9642-e950eb1a5730 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.767460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.768077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e992bb2-9b69-44fe-9642-e950eb1a5730 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.768513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e992bb2-9b69-44fe-9642-e950eb1a5730 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.797660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4e992bb2-9b69-44fe-9642-e950eb1a5730 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Mar 08 13:24:36.798556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 447/893] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:36.816330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8535614a-a247-4326-924f-57f2d407bbfb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:36.817264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8535614a-a247-4326-924f-57f2d407bbfb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:36.824495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8535614a-a247-4326-924f-57f2d407bbfb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.824972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8535614a-a247-4326-924f-57f2d407bbfb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.825742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8535614a-a247-4326-924f-57f2d407bbfb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:36.826174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8535614a-a247-4326-924f-57f2d407bbfb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:36.855143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8535614a-a247-4326-924f-57f2d407bbfb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Mar 08 13:24:36.855730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 448/894] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:36.907466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:36.915439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-43f3a037-b04f-4c14-9f3a-c5a42a87c56b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1577 microversion: 2.1 time: 0.160955 Mar 08 13:24:36.915982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 447/895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:36 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:37.646085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:37.646616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:37.652623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.653113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:37.653884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.654332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:37.794145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:37.803103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:37.804619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:37.805810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c7ddcf57-26d7-498c-a674-982fa169c13a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163796 Mar 08 13:24:37.806362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 449/896] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:37 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:37.809883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ca82cd1f-5485-4bc6-a008-65512e0ebb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:37.810848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ca82cd1f-5485-4bc6-a008-65512e0ebb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:37.817519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca82cd1f-5485-4bc6-a008-65512e0ebb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.817973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca82cd1f-5485-4bc6-a008-65512e0ebb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:37.818779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca82cd1f-5485-4bc6-a008-65512e0ebb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.819212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca82cd1f-5485-4bc6-a008-65512e0ebb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:37.848396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ca82cd1f-5485-4bc6-a008-65512e0ebb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Mar 08 13:24:37.851985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 448/897] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:37.871909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a2506fd2-426c-4808-b7c5-27176615afae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:37.873130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a2506fd2-426c-4808-b7c5-27176615afae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:37.879975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2506fd2-426c-4808-b7c5-27176615afae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.880431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2506fd2-426c-4808-b7c5-27176615afae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:37.881241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2506fd2-426c-4808-b7c5-27176615afae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.881682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2506fd2-426c-4808-b7c5-27176615afae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:37.913343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a2506fd2-426c-4808-b7c5-27176615afae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049788 Mar 08 13:24:37.913818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 450/898] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:37.931811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:37.932422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:37.938346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.938798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:37.940056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:37.940494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:38.079409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:38.087273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-985debbd-0854-42f0-9b0f-44e912ad97f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1577 microversion: 2.1 time: 0.159318 Mar 08 13:24:38.087826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 449/899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:37 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:38.824175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:38.824772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:38.831575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:38.833667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:38.833667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:38.833667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:38.861659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0c928f5e-0fb9-4a22-adbb-07b2dfcffc16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:38.862566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0c928f5e-0fb9-4a22-adbb-07b2dfcffc16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:38.868833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c928f5e-0fb9-4a22-adbb-07b2dfcffc16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:38.869280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c928f5e-0fb9-4a22-adbb-07b2dfcffc16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:38.870043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c928f5e-0fb9-4a22-adbb-07b2dfcffc16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:38.870474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0c928f5e-0fb9-4a22-adbb-07b2dfcffc16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:38.900083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0c928f5e-0fb9-4a22-adbb-07b2dfcffc16 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Mar 08 13:24:38.900635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 450/900] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:38.925179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1fd80a50-c88c-46be-917e-94f545be4075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:38.926084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1fd80a50-c88c-46be-917e-94f545be4075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:38.932123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1fd80a50-c88c-46be-917e-94f545be4075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:38.932570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1fd80a50-c88c-46be-917e-94f545be4075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:38.933374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1fd80a50-c88c-46be-917e-94f545be4075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:38.933797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1fd80a50-c88c-46be-917e-94f545be4075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:38.998839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1fd80a50-c88c-46be-917e-94f545be4075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Mar 08 13:24:38.998839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 451/901] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:38.999903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:38.999903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:39.000382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:39.000382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4750747f-950c-4e7f-a898-6ad60af5b8f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.174926 Mar 08 13:24:39.000382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 451/902] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:38 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:39.104955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:39.105560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:39.111329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:39.111835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:39.112582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:39.113074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:39.213157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:39.221224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-07fd109d-539f-4348-86eb-c05402526a7f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1510 microversion: 2.1 time: 0.119739 Mar 08 13:24:39.222000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 452/903] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:39 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1510 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:39.341674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-d9e2b03f-eccb-4ae5-9327-b7320df57ecd req-876592e0-858b-4d98-a106-17c43892ee1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4990fb-f02f-4297-a1c5-b1970d04c24c", "name": "network-vif-deleted", "tag": "7958797c-844d-4a07-8ade-398ea8375499"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:24:39.348332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-d9e2b03f-eccb-4ae5-9327-b7320df57ecd req-876592e0-858b-4d98-a106-17c43892ee1d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:39.348805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-d9e2b03f-eccb-4ae5-9327-b7320df57ecd req-876592e0-858b-4d98-a106-17c43892ee1d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:39.365094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-d9e2b03f-eccb-4ae5-9327-b7320df57ecd req-876592e0-858b-4d98-a106-17c43892ee1d service nova] Creating event network-vif-deleted:7958797c-844d-4a07-8ade-398ea8375499 for instance 0d4990fb-f02f-4297-a1c5-b1970d04c24c on hv-cinder-83009 Mar 08 13:24:39.367217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-d9e2b03f-eccb-4ae5-9327-b7320df57ecd req-876592e0-858b-4d98-a106-17c43892ee1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100518 Mar 08 13:24:39.367814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 452/904] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:39.911901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1ca8e894-a33e-43ad-ae11-0ce33bc653cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:39.912766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1ca8e894-a33e-43ad-ae11-0ce33bc653cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:39.919127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ca8e894-a33e-43ad-ae11-0ce33bc653cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:39.919672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ca8e894-a33e-43ad-ae11-0ce33bc653cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:39.920336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ca8e894-a33e-43ad-ae11-0ce33bc653cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:39.920798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ca8e894-a33e-43ad-ae11-0ce33bc653cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:39.950217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1ca8e894-a33e-43ad-ae11-0ce33bc653cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 Mar 08 13:24:39.950781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 453/905] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:39.979239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-17e56f7c-982c-41bf-b9f6-a50a68a595b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:39.980236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-17e56f7c-982c-41bf-b9f6-a50a68a595b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:39.986934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17e56f7c-982c-41bf-b9f6-a50a68a595b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:39.987533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17e56f7c-982c-41bf-b9f6-a50a68a595b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:39.988141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17e56f7c-982c-41bf-b9f6-a50a68a595b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:39.988578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17e56f7c-982c-41bf-b9f6-a50a68a595b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:40.013862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:40.014473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:40.021427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:40.021558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-17e56f7c-982c-41bf-b9f6-a50a68a595b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046674 Mar 08 13:24:40.021884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:40.022451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 453/906] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:40.022682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:40.023100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:40.167773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:40.177481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:40.179283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:40.180362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c5e2639d-7bef-4fbd-8517-f6c4a1e10f3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.170385 Mar 08 13:24:40.181064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 454/907] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:40.238712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:40.239324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:40.245237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:40.245691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:40.246456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:40.246895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:40.312309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:40.319735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-36c72b80-3ad4-4404-95e8-099b3674d78c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085579 Mar 08 13:24:40.320289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 454/908] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:40 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:40.962461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3331b532-0ee4-47d5-ad76-24c6d5408897 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:40.963359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3331b532-0ee4-47d5-ad76-24c6d5408897 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:40.969546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3331b532-0ee4-47d5-ad76-24c6d5408897 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:40.969989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3331b532-0ee4-47d5-ad76-24c6d5408897 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:40.970738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3331b532-0ee4-47d5-ad76-24c6d5408897 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:40.971235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3331b532-0ee4-47d5-ad76-24c6d5408897 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:40.998600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3331b532-0ee4-47d5-ad76-24c6d5408897 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039894 Mar 08 13:24:40.999132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 455/909] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:41.033378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-73a47404-6501-45a5-8ae6-408be4dbf4ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:41.034619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-73a47404-6501-45a5-8ae6-408be4dbf4ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:41.043830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a47404-6501-45a5-8ae6-408be4dbf4ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:41.044497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a47404-6501-45a5-8ae6-408be4dbf4ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:41.045761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a47404-6501-45a5-8ae6-408be4dbf4ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:41.046426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73a47404-6501-45a5-8ae6-408be4dbf4ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:41.080428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-73a47404-6501-45a5-8ae6-408be4dbf4ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050563 Mar 08 13:24:41.081319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 455/910] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:41.199328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:41.199931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:41.205909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:41.206365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:41.207135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:41.207575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:41.336932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:41.337600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:41.341590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:41.343757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:41.344209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:41.345013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:41.345451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:41.351074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:41.352577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:41.353773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2bfb2c42-dcd9-4fbd-976e-17615da8ec76 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158358 Mar 08 13:24:41.354328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 456/911] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:41.407961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:41.417006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cc28e70d-6a92-4d15-9ff3-d1a2c3895967 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083726 Mar 08 13:24:41.417572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 456/912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:24:42.010587 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-17d09833-ca61-4448-a57e-49c474b05c7c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:42.011486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-17d09833-ca61-4448-a57e-49c474b05c7c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:42.017669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d09833-ca61-4448-a57e-49c474b05c7c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.018272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d09833-ca61-4448-a57e-49c474b05c7c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.019033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d09833-ca61-4448-a57e-49c474b05c7c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.019462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d09833-ca61-4448-a57e-49c474b05c7c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.047008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-17d09833-ca61-4448-a57e-49c474b05c7c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040352 Mar 08 13:24:42.047535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 457/913] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:42.092116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-74741631-41a5-4bcd-a957-6a464d9710d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:42.093066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-74741631-41a5-4bcd-a957-6a464d9710d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:42.103928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74741631-41a5-4bcd-a957-6a464d9710d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.104380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74741631-41a5-4bcd-a957-6a464d9710d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.105197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74741631-41a5-4bcd-a957-6a464d9710d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.105636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74741631-41a5-4bcd-a957-6a464d9710d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.134674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-74741631-41a5-4bcd-a957-6a464d9710d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Mar 08 13:24:42.135218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 457/914] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:42.371283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:42.371888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:42.378656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.379099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.379859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.380293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.434285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:42.434898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:42.441581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.442030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.442806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:42.443263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:42.502786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:42.512749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:42.514316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e52f067a-8072-4a77-be91-e939b90b64ae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083861 Mar 08 13:24:42.515082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 458/915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:24:42.521159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:42.522780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:42.523930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9fca60a9-273a-4542-a0ae-9874ceec0fc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156518 Mar 08 13:24:42.524477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 458/916] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:43.059164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b3936ab0-cd6d-49c9-9e85-418c2385e96e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:43.060070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b3936ab0-cd6d-49c9-9e85-418c2385e96e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:43.066722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3936ab0-cd6d-49c9-9e85-418c2385e96e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.067173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3936ab0-cd6d-49c9-9e85-418c2385e96e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.067929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3936ab0-cd6d-49c9-9e85-418c2385e96e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.068363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3936ab0-cd6d-49c9-9e85-418c2385e96e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.095975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b3936ab0-cd6d-49c9-9e85-418c2385e96e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040782 Mar 08 13:24:43.096837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 459/917] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:43.146650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-763faadc-64de-46c5-8298-d7b38037636b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:43.147591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-763faadc-64de-46c5-8298-d7b38037636b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:43.153811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-763faadc-64de-46c5-8298-d7b38037636b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.154271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-763faadc-64de-46c5-8298-d7b38037636b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.155043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-763faadc-64de-46c5-8298-d7b38037636b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.155488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-763faadc-64de-46c5-8298-d7b38037636b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.182876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-763faadc-64de-46c5-8298-d7b38037636b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040856 Mar 08 13:24:43.183412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 459/918] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:43.530850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:43.531458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:43.537999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.538447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.539215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.539657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.542182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:43.542789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:43.548517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.549560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.550317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:43.550758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:43.600500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:43.608207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ea23058e-47e6-4b70-8aac-647fdc1c4fb1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081253 Mar 08 13:24:43.608795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 460/919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:43 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:43.683163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:43.691295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:43.692834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:43.693992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-23905155-b964-45f2-b5cc-4d4049223ba2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155702 Mar 08 13:24:43.694541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 460/920] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:44.107388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8ce7d0d0-971c-4a73-9c1c-0840301fe970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:44.108288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8ce7d0d0-971c-4a73-9c1c-0840301fe970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:44.114810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ce7d0d0-971c-4a73-9c1c-0840301fe970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.115252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ce7d0d0-971c-4a73-9c1c-0840301fe970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.116011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ce7d0d0-971c-4a73-9c1c-0840301fe970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.116442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ce7d0d0-971c-4a73-9c1c-0840301fe970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.144606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8ce7d0d0-971c-4a73-9c1c-0840301fe970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041150 Mar 08 13:24:44.145197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 461/921] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:44.194932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-34290d4d-82c0-4c20-b069-4d976e82caa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:44.195870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-34290d4d-82c0-4c20-b069-4d976e82caa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:44.202525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34290d4d-82c0-4c20-b069-4d976e82caa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.202974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34290d4d-82c0-4c20-b069-4d976e82caa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.203737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34290d4d-82c0-4c20-b069-4d976e82caa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.204173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34290d4d-82c0-4c20-b069-4d976e82caa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.231500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-34290d4d-82c0-4c20-b069-4d976e82caa8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040469 Mar 08 13:24:44.232041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 461/922] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:44.625977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:44.626499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:44.633176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.633627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.634380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.634810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.692398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:44.699615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1231edc1-d908-4aa5-bedc-2a2a9469d413 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077945 Mar 08 13:24:44.700168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 462/923] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:44 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:44.711830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:44.712443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:44.718120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.718566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.719350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:44.719785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:44.848850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:44.857105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:44.858597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:44.859734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ccd01b15-f9df-4c34-843c-82a3e0cfbd7f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151822 Mar 08 13:24:44.860281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 462/924] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:45.155448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8e7778cd-b713-4023-8662-2ba670ed9770 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:45.156347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8e7778cd-b713-4023-8662-2ba670ed9770 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:45.162835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e7778cd-b713-4023-8662-2ba670ed9770 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.163279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e7778cd-b713-4023-8662-2ba670ed9770 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:45.164035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e7778cd-b713-4023-8662-2ba670ed9770 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.164484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e7778cd-b713-4023-8662-2ba670ed9770 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:45.192696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8e7778cd-b713-4023-8662-2ba670ed9770 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Mar 08 13:24:45.193237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 463/925] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:45.243310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-88248f7d-1dc6-4ec0-9a9b-c9f6711d6727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:45.244213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-88248f7d-1dc6-4ec0-9a9b-c9f6711d6727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:45.250682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88248f7d-1dc6-4ec0-9a9b-c9f6711d6727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.251131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88248f7d-1dc6-4ec0-9a9b-c9f6711d6727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:45.251887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88248f7d-1dc6-4ec0-9a9b-c9f6711d6727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.252527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88248f7d-1dc6-4ec0-9a9b-c9f6711d6727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:45.279954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-88248f7d-1dc6-4ec0-9a9b-c9f6711d6727 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 Mar 08 13:24:45.280490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 463/926] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:45.716845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:45.717457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:45.724400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.724895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:45.725663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.726129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:45.784619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:45.791846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-02a1825b-5794-47ac-9072-3dece5aa5ba2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078893 Mar 08 13:24:45.792409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 464/927] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:45 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:45.878171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:45.878776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:45.884642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.885121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:45.890341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:45.890341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:46.018454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:46.026505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:46.027994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:46.029163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a8132a00-f378-4259-a371-ca4c17d1c73b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155035 Mar 08 13:24:46.029720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 464/928] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:46.203531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-88319f91-7549-46b1-af18-80a22dc0dbef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:46.204435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-88319f91-7549-46b1-af18-80a22dc0dbef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:46.211013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88319f91-7549-46b1-af18-80a22dc0dbef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:46.211467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88319f91-7549-46b1-af18-80a22dc0dbef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:46.212230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88319f91-7549-46b1-af18-80a22dc0dbef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:46.212686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88319f91-7549-46b1-af18-80a22dc0dbef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:46.240340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-88319f91-7549-46b1-af18-80a22dc0dbef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040749 Mar 08 13:24:46.240851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 465/929] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:46.291041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3bc7cc43-723b-423e-8c0e-1c66e2cfaf77 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:46.291941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3bc7cc43-723b-423e-8c0e-1c66e2cfaf77 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:46.298162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bc7cc43-723b-423e-8c0e-1c66e2cfaf77 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:46.298609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bc7cc43-723b-423e-8c0e-1c66e2cfaf77 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:46.299993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bc7cc43-723b-423e-8c0e-1c66e2cfaf77 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:46.300434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bc7cc43-723b-423e-8c0e-1c66e2cfaf77 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:46.328798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3bc7cc43-723b-423e-8c0e-1c66e2cfaf77 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Mar 08 13:24:46.329342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 465/930] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:46.808442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:46.809079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:46.815257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:46.823851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:46.823851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:46.823851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:46.879155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:46.886627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ede92d31-e5b2-46bf-a5e0-b77f2d7eea9a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082059 Mar 08 13:24:46.887263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 466/931] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:47.047741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:47.048342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:47.054804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.055245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.055996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.056426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.191043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:47.199278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:47.200809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:47.201937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6597e758-9d23-47ba-9dd0-08d3b4fdad8e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158034 Mar 08 13:24:47.202482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 466/932] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:47.251932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a8b7cdd1-62c9-4913-9245-0a7ddb9293bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:47.253041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a8b7cdd1-62c9-4913-9245-0a7ddb9293bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:47.258784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8b7cdd1-62c9-4913-9245-0a7ddb9293bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.260489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8b7cdd1-62c9-4913-9245-0a7ddb9293bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.260489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8b7cdd1-62c9-4913-9245-0a7ddb9293bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.260489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8b7cdd1-62c9-4913-9245-0a7ddb9293bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.288649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a8b7cdd1-62c9-4913-9245-0a7ddb9293bd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040977 Mar 08 13:24:47.289223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 467/933] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:47.339286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fabf927d-c56f-42e4-9f65-707cd303508c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:47.340192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fabf927d-c56f-42e4-9f65-707cd303508c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:47.347502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fabf927d-c56f-42e4-9f65-707cd303508c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.347964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fabf927d-c56f-42e4-9f65-707cd303508c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.348794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fabf927d-c56f-42e4-9f65-707cd303508c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.349601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fabf927d-c56f-42e4-9f65-707cd303508c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.377587 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fabf927d-c56f-42e4-9f65-707cd303508c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041917 Mar 08 13:24:47.378126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 467/934] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:47.902801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:47.903443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:47.909856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.910305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.911068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:47.911506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:47.969835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:47.977266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4dfa70b-2935-4045-a2cd-e328e245b63e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078299 Mar 08 13:24:47.977824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 468/935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:48.220431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:48.221653 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:48.227741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:48.228194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:48.228984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:48.229418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:48.300422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-36fb65e1-8fdf-4a4d-947a-207d8bbcaf1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:48.301404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-36fb65e1-8fdf-4a4d-947a-207d8bbcaf1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:48.307200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36fb65e1-8fdf-4a4d-947a-207d8bbcaf1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:48.307606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36fb65e1-8fdf-4a4d-947a-207d8bbcaf1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:48.308402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36fb65e1-8fdf-4a4d-947a-207d8bbcaf1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:48.308871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36fb65e1-8fdf-4a4d-947a-207d8bbcaf1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:48.340598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-36fb65e1-8fdf-4a4d-947a-207d8bbcaf1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Mar 08 13:24:48.341428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 469/936] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:48.363557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:48.372464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:48.374244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:48.375374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-84b07caa-ae26-4fad-b018-2b0f1cdffe17 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158798 Mar 08 13:24:48.375925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 468/937] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:48 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:48.388634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-adfd0842-38db-47e9-9917-7be7b320f5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:48.389561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-adfd0842-38db-47e9-9917-7be7b320f5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:48.395709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adfd0842-38db-47e9-9917-7be7b320f5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:48.396157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adfd0842-38db-47e9-9917-7be7b320f5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:48.396952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adfd0842-38db-47e9-9917-7be7b320f5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:48.397391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-adfd0842-38db-47e9-9917-7be7b320f5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:48.426258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-adfd0842-38db-47e9-9917-7be7b320f5e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041405 Mar 08 13:24:48.426816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 470/938] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:48.993790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:48.994404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:49.000527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.001011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.001774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.002239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.066027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:49.073915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eeeaa526-30a5-4188-8800-f04b63c59a83 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083926 Mar 08 13:24:49.074468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 469/939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:48 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:49.352826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-41ad1a0d-9485-4892-8b1d-c3d241b29e06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:49.353728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-41ad1a0d-9485-4892-8b1d-c3d241b29e06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:49.359978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41ad1a0d-9485-4892-8b1d-c3d241b29e06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.360424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41ad1a0d-9485-4892-8b1d-c3d241b29e06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.361234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41ad1a0d-9485-4892-8b1d-c3d241b29e06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.362229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41ad1a0d-9485-4892-8b1d-c3d241b29e06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.390226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-41ad1a0d-9485-4892-8b1d-c3d241b29e06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041307 Mar 08 13:24:49.390777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 471/940] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:49.392957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:49.393852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:49.400110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.400553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.401347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.401784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.437536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-da797cf5-fae6-4553-a478-b3803ba52e27 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:49.438510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-da797cf5-fae6-4553-a478-b3803ba52e27 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:49.445098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da797cf5-fae6-4553-a478-b3803ba52e27 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.445545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da797cf5-fae6-4553-a478-b3803ba52e27 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.446307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da797cf5-fae6-4553-a478-b3803ba52e27 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:49.446734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da797cf5-fae6-4553-a478-b3803ba52e27 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:49.474229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-da797cf5-fae6-4553-a478-b3803ba52e27 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Mar 08 13:24:49.474786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 472/941] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:49.534861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:49.543015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:49.544495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:49.545718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1d5edd23-9ff6-4817-af10-6e32dd7e9659 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156790 Mar 08 13:24:49.546270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 470/942] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:50.090545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:50.091156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:50.097744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.098194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.098959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.099393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.159776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:50.168059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-51bdc963-d168-498c-9e53-75bc3ab263cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081379 Mar 08 13:24:50.168611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 473/943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:50.401588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1741a772-faae-4212-9a4d-7f4813422364 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:50.402527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1741a772-faae-4212-9a4d-7f4813422364 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:50.408900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1741a772-faae-4212-9a4d-7f4813422364 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.409352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1741a772-faae-4212-9a4d-7f4813422364 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.410120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1741a772-faae-4212-9a4d-7f4813422364 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.410557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1741a772-faae-4212-9a4d-7f4813422364 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.438478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1741a772-faae-4212-9a4d-7f4813422364 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040750 Mar 08 13:24:50.439218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 471/944] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:50.484832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fb56a1b3-6cb9-4644-a02c-aad0e7292a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:50.485744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fb56a1b3-6cb9-4644-a02c-aad0e7292a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:50.492630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb56a1b3-6cb9-4644-a02c-aad0e7292a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.493110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb56a1b3-6cb9-4644-a02c-aad0e7292a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.493873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb56a1b3-6cb9-4644-a02c-aad0e7292a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.494310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb56a1b3-6cb9-4644-a02c-aad0e7292a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.522395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fb56a1b3-6cb9-4644-a02c-aad0e7292a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 Mar 08 13:24:50.522945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 474/945] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:50.563782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:50.564383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:50.570332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.570772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.571520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:50.571949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:50.699827 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:50.708038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:50.709630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:50.710783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-948e5908-5fcc-4d92-b4b5-eab9fccb5e49 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.150935 Mar 08 13:24:50.711334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 472/946] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:51.184486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:51.185116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:51.191489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.191937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.192723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.193159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.251123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:51.258860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8e0c73e7-6e8c-4008-a166-bff7f7bfc67c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078198 Mar 08 13:24:51.259414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 475/947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:51.450702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-31b86b7e-713a-4844-9121-b8e9747bc7cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:51.451542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-31b86b7e-713a-4844-9121-b8e9747bc7cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:51.458075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b86b7e-713a-4844-9121-b8e9747bc7cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.458522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b86b7e-713a-4844-9121-b8e9747bc7cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.459282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b86b7e-713a-4844-9121-b8e9747bc7cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.459848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31b86b7e-713a-4844-9121-b8e9747bc7cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.496954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-31b86b7e-713a-4844-9121-b8e9747bc7cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049983 Mar 08 13:24:51.497525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 473/948] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:51.534341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-81f8a08d-7c0a-460a-b604-657c497dae24 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:51.535330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-81f8a08d-7c0a-460a-b604-657c497dae24 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:51.541645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81f8a08d-7c0a-460a-b604-657c497dae24 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.542089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81f8a08d-7c0a-460a-b604-657c497dae24 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.542845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81f8a08d-7c0a-460a-b604-657c497dae24 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.543274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81f8a08d-7c0a-460a-b604-657c497dae24 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.571431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-81f8a08d-7c0a-460a-b604-657c497dae24 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Mar 08 13:24:51.571976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 476/949] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:51.729361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:51.729912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:51.735706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.736163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.737173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:51.737620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:51.870389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:51.879310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:51.880856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:51.882052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0938b272-0fee-4c5e-8396-c7b354896a2c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156641 Mar 08 13:24:51.882695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 474/950] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:52.275342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:52.275990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:52.281849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.282298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:52.283054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.283491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:52.345027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:52.353297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-285bcb75-219c-40ea-ae53-98e8962ed505 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081785 Mar 08 13:24:52.353911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 477/951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:52 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:52.509588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-63c23348-fd55-41a8-891b-e20713381657 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:52.510516 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-63c23348-fd55-41a8-891b-e20713381657 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:52.516831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c23348-fd55-41a8-891b-e20713381657 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.517283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c23348-fd55-41a8-891b-e20713381657 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:52.519121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c23348-fd55-41a8-891b-e20713381657 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.519548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c23348-fd55-41a8-891b-e20713381657 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:52.554442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-63c23348-fd55-41a8-891b-e20713381657 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048624 Mar 08 13:24:52.554923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 475/952] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:52.582927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bcfd2b3a-5c74-4c7d-b68b-dfd8b380b1b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:52.583893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bcfd2b3a-5c74-4c7d-b68b-dfd8b380b1b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:52.590209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b3a-5c74-4c7d-b68b-dfd8b380b1b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.590660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b3a-5c74-4c7d-b68b-dfd8b380b1b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:52.591424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b3a-5c74-4c7d-b68b-dfd8b380b1b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.591862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b3a-5c74-4c7d-b68b-dfd8b380b1b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:52.619825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bcfd2b3a-5c74-4c7d-b68b-dfd8b380b1b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040820 Mar 08 13:24:52.620368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 478/953] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:52.900162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:52.900714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:52.906563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.907018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:52.907783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:52.908217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:53.037084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:53.045174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:53.046673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:53.047805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e5b513e6-333d-4ed0-8b11-ef6591367372 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151641 Mar 08 13:24:53.048362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 476/954] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:53.370246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:53.371916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:53.376933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:53.377449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:53.378296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:53.378723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:53.445951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:53.453463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-448b5298-2495-4b33-8c32-b9eafb41329c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087149 Mar 08 13:24:53.454309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 479/955] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:53 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:53.566859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ac2f3157-9749-43d7-97bc-4a1975f5b429 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:53.570751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ac2f3157-9749-43d7-97bc-4a1975f5b429 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:53.574181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac2f3157-9749-43d7-97bc-4a1975f5b429 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:53.574641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac2f3157-9749-43d7-97bc-4a1975f5b429 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:53.575468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac2f3157-9749-43d7-97bc-4a1975f5b429 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:53.575911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac2f3157-9749-43d7-97bc-4a1975f5b429 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:53.604903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ac2f3157-9749-43d7-97bc-4a1975f5b429 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042671 Mar 08 13:24:53.605466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 477/956] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:53.632048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c2bdcba4-b559-4a2c-abb8-8fb42d404930 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:53.633288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c2bdcba4-b559-4a2c-abb8-8fb42d404930 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:53.639458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2bdcba4-b559-4a2c-abb8-8fb42d404930 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:53.639943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2bdcba4-b559-4a2c-abb8-8fb42d404930 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:53.640731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2bdcba4-b559-4a2c-abb8-8fb42d404930 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:53.641165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2bdcba4-b559-4a2c-abb8-8fb42d404930 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:53.670680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c2bdcba4-b559-4a2c-abb8-8fb42d404930 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Mar 08 13:24:53.671248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 480/957] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:54.067389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:54.067907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:54.073775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.074218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.074980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.075406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.211240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:54.219643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:54.221267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:54.222536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8e71fc1d-d866-43ad-9fd5-69958c304f92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159803 Mar 08 13:24:54.223123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 478/958] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:54.472012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:54.472624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:54.478855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.479316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.480087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.480522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.542464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:54.550518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-30fe48c3-4b94-4312-b7b9-97ab817971fe tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083245 Mar 08 13:24:54.551095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 481/959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:54 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:54.616737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-34bfbc45-bb53-4d1e-804e-264827082c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:54.617581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-34bfbc45-bb53-4d1e-804e-264827082c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:54.624242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bfbc45-bb53-4d1e-804e-264827082c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.624713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bfbc45-bb53-4d1e-804e-264827082c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.625478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bfbc45-bb53-4d1e-804e-264827082c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.625912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bfbc45-bb53-4d1e-804e-264827082c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.654387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-34bfbc45-bb53-4d1e-804e-264827082c70 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Mar 08 13:24:54.654938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 479/960] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:54.682291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dcc6f0d4-62fc-45ba-b455-5299a2c9d0ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:54.683226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dcc6f0d4-62fc-45ba-b455-5299a2c9d0ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:54.689705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcc6f0d4-62fc-45ba-b455-5299a2c9d0ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.690615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcc6f0d4-62fc-45ba-b455-5299a2c9d0ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.691395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcc6f0d4-62fc-45ba-b455-5299a2c9d0ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:54.691840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcc6f0d4-62fc-45ba-b455-5299a2c9d0ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:54.720002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dcc6f0d4-62fc-45ba-b455-5299a2c9d0ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041713 Mar 08 13:24:54.720551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 482/961] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:55.240112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:55.240733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:55.246616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.247061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.247815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.248247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.379935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:55.388030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:55.389546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:55.390678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-09762b97-6877-4a88-8edb-046af1bd68a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154493 Mar 08 13:24:55.391218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 480/962] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:55.567130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:55.567696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:55.573771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.574224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.574989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.575423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.634381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:55.641576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c151ba88-9036-46fa-bf6e-5eb83a9c7e0f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078494 Mar 08 13:24:55.642142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 483/963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:55.665590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-59f04c78-cd75-4b6e-9160-06d2120b0a2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:55.666495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-59f04c78-cd75-4b6e-9160-06d2120b0a2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:55.672560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59f04c78-cd75-4b6e-9160-06d2120b0a2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.673039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59f04c78-cd75-4b6e-9160-06d2120b0a2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.673822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59f04c78-cd75-4b6e-9160-06d2120b0a2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.674881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59f04c78-cd75-4b6e-9160-06d2120b0a2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.702307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-59f04c78-cd75-4b6e-9160-06d2120b0a2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040554 Mar 08 13:24:55.702843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 481/964] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:55.732552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d7c8a418-9c15-49f0-9599-93bdaa994466 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:55.733483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d7c8a418-9c15-49f0-9599-93bdaa994466 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:55.740264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7c8a418-9c15-49f0-9599-93bdaa994466 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.740746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7c8a418-9c15-49f0-9599-93bdaa994466 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.741516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7c8a418-9c15-49f0-9599-93bdaa994466 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:55.741957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7c8a418-9c15-49f0-9599-93bdaa994466 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:55.769537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d7c8a418-9c15-49f0-9599-93bdaa994466 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040941 Mar 08 13:24:55.770092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 484/965] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:56.411361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:56.411972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:56.418007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.418476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.419280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.419720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.568462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:56.585019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:56.586500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:56.587637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fcef50b1-c09a-4537-af4f-36fc04a0c345 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.181988 Mar 08 13:24:56.588186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 482/966] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:56.658028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:56.658724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:56.664341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.664823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.665607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.666037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.715923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-33b8cf50-04d0-49e1-bd0c-d8408e74b5c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:56.716856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-33b8cf50-04d0-49e1-bd0c-d8408e74b5c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:56.723974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33b8cf50-04d0-49e1-bd0c-d8408e74b5c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.724424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33b8cf50-04d0-49e1-bd0c-d8408e74b5c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.724823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:56.725381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33b8cf50-04d0-49e1-bd0c-d8408e74b5c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.725818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33b8cf50-04d0-49e1-bd0c-d8408e74b5c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.731982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6e8c033a-16f8-4fb1-a795-d7e3e3beab9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077822 Mar 08 13:24:56.732531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 485/967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:56 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:56.754718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-33b8cf50-04d0-49e1-bd0c-d8408e74b5c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Mar 08 13:24:56.755262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 483/968] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:56.780307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8442c5b5-0e71-40b6-84d4-94559cf0f35c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:56.781258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8442c5b5-0e71-40b6-84d4-94559cf0f35c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:56.787878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8442c5b5-0e71-40b6-84d4-94559cf0f35c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.788334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8442c5b5-0e71-40b6-84d4-94559cf0f35c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.789162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8442c5b5-0e71-40b6-84d4-94559cf0f35c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:56.789604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8442c5b5-0e71-40b6-84d4-94559cf0f35c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:56.823451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8442c5b5-0e71-40b6-84d4-94559cf0f35c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047040 Mar 08 13:24:56.828638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 486/969] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:57.606300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:57.606829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:57.612996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.613447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.614214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.614656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.742614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:57.748481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:57.749378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:57.751067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:57.753318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:57.754473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3de5887e-096c-4941-b8c2-9d7c11f91200 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152179 Mar 08 13:24:57.755020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 484/970] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:24:57.756100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.756558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.757356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.757797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.765591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f13026d1-b900-47f5-bbef-36b7a1f9a3fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:57.766537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f13026d1-b900-47f5-bbef-36b7a1f9a3fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:57.772185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f13026d1-b900-47f5-bbef-36b7a1f9a3fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.772630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f13026d1-b900-47f5-bbef-36b7a1f9a3fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.773426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f13026d1-b900-47f5-bbef-36b7a1f9a3fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.773855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f13026d1-b900-47f5-bbef-36b7a1f9a3fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.802849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f13026d1-b900-47f5-bbef-36b7a1f9a3fd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040865 Mar 08 13:24:57.803405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 485/971] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:24:57.819713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:57.827035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a209bde9-ba0a-4307-a745-e1d6466bb973 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082402 Mar 08 13:24:57.827585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 487/972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:24:57.838576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7108ebbe-6a13-4d29-bcb3-cfddd1f6510a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:57.839648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7108ebbe-6a13-4d29-bcb3-cfddd1f6510a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:57.845481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7108ebbe-6a13-4d29-bcb3-cfddd1f6510a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.850610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7108ebbe-6a13-4d29-bcb3-cfddd1f6510a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.850610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7108ebbe-6a13-4d29-bcb3-cfddd1f6510a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:57.850610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7108ebbe-6a13-4d29-bcb3-cfddd1f6510a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:57.879240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7108ebbe-6a13-4d29-bcb3-cfddd1f6510a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042468 Mar 08 13:24:57.879240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 486/973] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:58.773505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:58.774110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:58.779882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.780332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.781120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.781557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.814311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6d857954-1e2f-43ed-ae74-239be84025b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:58.815722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6d857954-1e2f-43ed-ae74-239be84025b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:58.822142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d857954-1e2f-43ed-ae74-239be84025b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.822589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d857954-1e2f-43ed-ae74-239be84025b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.823357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d857954-1e2f-43ed-ae74-239be84025b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.823792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d857954-1e2f-43ed-ae74-239be84025b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.852947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6d857954-1e2f-43ed-ae74-239be84025b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042343 Mar 08 13:24:58.853509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 487/974] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:58.858027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:58.858632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:58.864471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.864954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.865726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.866161 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.918298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:58.925894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:58.926757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:58.928244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:24:58.929430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3492def6-9369-4fa5-acf3-d384e3800d69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159864 Mar 08 13:24:58.929990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 488/975] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:24:58.933688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0fe3ef39-b01c-4fe4-9b36-f54786c74cb9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079212 Mar 08 13:24:58.934382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 488/976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:24:58.934498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-47dc372d-e4d1-4b49-9c39-92a955562eec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:58.935312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-47dc372d-e4d1-4b49-9c39-92a955562eec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:58.941678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47dc372d-e4d1-4b49-9c39-92a955562eec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.942121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47dc372d-e4d1-4b49-9c39-92a955562eec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.942880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47dc372d-e4d1-4b49-9c39-92a955562eec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:58.943307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47dc372d-e4d1-4b49-9c39-92a955562eec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:58.970687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-47dc372d-e4d1-4b49-9c39-92a955562eec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039739 Mar 08 13:24:58.971253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 489/977] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:59.864206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-da5e4a9b-8457-4784-a6a5-d4f070e07e4c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:59.865190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-da5e4a9b-8457-4784-a6a5-d4f070e07e4c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:59.871486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-da5e4a9b-8457-4784-a6a5-d4f070e07e4c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:59.871934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-da5e4a9b-8457-4784-a6a5-d4f070e07e4c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:59.872728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-da5e4a9b-8457-4784-a6a5-d4f070e07e4c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:59.873166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-da5e4a9b-8457-4784-a6a5-d4f070e07e4c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:59.901656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-da5e4a9b-8457-4784-a6a5-d4f070e07e4c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Mar 08 13:24:59.902215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 489/978] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:24:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:24:59.949675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:59.950313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:24:59.950455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:59.950924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:24:59.957317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:59.957650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:59.957813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:59.958105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:59.958539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:59.958866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:24:59.958968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:24:59.959304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:00.023232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:00.030376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-485e8439-2622-4387-beb4-070b69aaf9f8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083760 Mar 08 13:25:00.030948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 490/979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:24:59 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:00.036244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c0c3db9f-47a9-4b33-b8ec-9a9061ae21d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:00.037178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c0c3db9f-47a9-4b33-b8ec-9a9061ae21d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:00.042866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0c3db9f-47a9-4b33-b8ec-9a9061ae21d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:00.043181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0c3db9f-47a9-4b33-b8ec-9a9061ae21d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:00.043944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0c3db9f-47a9-4b33-b8ec-9a9061ae21d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:00.044372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0c3db9f-47a9-4b33-b8ec-9a9061ae21d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:00.072731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c0c3db9f-47a9-4b33-b8ec-9a9061ae21d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040749 Mar 08 13:25:00.073283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 491/980] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:00.091795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:00.100718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:00.102282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:00.103426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7f06eef0-fc1b-4378-9d82-60c75678bec9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157658 Mar 08 13:25:00.103977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 490/981] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:24:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:00.913709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-052fc5fd-d425-4491-993d-509fef43a13c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:00.914613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-052fc5fd-d425-4491-993d-509fef43a13c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:00.920883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-052fc5fd-d425-4491-993d-509fef43a13c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:00.921335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-052fc5fd-d425-4491-993d-509fef43a13c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:00.922101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-052fc5fd-d425-4491-993d-509fef43a13c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:00.922535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-052fc5fd-d425-4491-993d-509fef43a13c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:00.951226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-052fc5fd-d425-4491-993d-509fef43a13c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Mar 08 13:25:00.951768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 492/982] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:01.047302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:01.047906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:01.054988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.055434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:01.056203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.056641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:01.084335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3c8d6fc4-6d08-438a-955f-537eff62bd1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:01.085285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3c8d6fc4-6d08-438a-955f-537eff62bd1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:01.091320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fc4-6d08-438a-955f-537eff62bd1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.091796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fc4-6d08-438a-955f-537eff62bd1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:01.092621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fc4-6d08-438a-955f-537eff62bd1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.093105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c8d6fc4-6d08-438a-955f-537eff62bd1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:01.117178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:01.123057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3c8d6fc4-6d08-438a-955f-537eff62bd1e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042600 Mar 08 13:25:01.123616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 493/983] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:01.124885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-02d7e8d1-c429-4436-b6e6-405aa146dc1e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081367 Mar 08 13:25:01.125436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 491/984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:01.130400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:01.131010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:01.136769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.137226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:01.137989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.138429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:01.270656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:01.278689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:01.280169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:01.281328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ec5c7d8d-193f-45e3-b613-a99589812752 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156559 Mar 08 13:25:01.281883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 494/985] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:01.962987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3e1e8a92-b2cb-4774-b47a-922d6c20b8c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:01.963936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3e1e8a92-b2cb-4774-b47a-922d6c20b8c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:01.969682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e1e8a92-b2cb-4774-b47a-922d6c20b8c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.970144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e1e8a92-b2cb-4774-b47a-922d6c20b8c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:01.970909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e1e8a92-b2cb-4774-b47a-922d6c20b8c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:01.971939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e1e8a92-b2cb-4774-b47a-922d6c20b8c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:02.001421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3e1e8a92-b2cb-4774-b47a-922d6c20b8c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Mar 08 13:25:02.002026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 492/986] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:02.134983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-55bd9712-6a0f-4f4b-be37-0c3555a7865a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:02.135811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-55bd9712-6a0f-4f4b-be37-0c3555a7865a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:02.141670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:02.142104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55bd9712-6a0f-4f4b-be37-0c3555a7865a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:02.142303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:02.142449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55bd9712-6a0f-4f4b-be37-0c3555a7865a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:02.143642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55bd9712-6a0f-4f4b-be37-0c3555a7865a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:02.144087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55bd9712-6a0f-4f4b-be37-0c3555a7865a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:02.149120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:02.149569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:02.150321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:02.150753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:02.172630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-55bd9712-6a0f-4f4b-be37-0c3555a7865a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041603 Mar 08 13:25:02.173213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 495/987] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:02.211326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:02.218743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c9a47235-444c-41cc-81b8-5b06a12431c6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080764 Mar 08 13:25:02.219296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 493/988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:02.301297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:02.301898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:02.307774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:02.308214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:02.308998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:02.309423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:02.437950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:02.446582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:02.448075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:02.449245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-33ac735e-8363-4413-8ca9-0e5d9ed0417b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152417 Mar 08 13:25:02.449796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 496/989] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:03.013115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2c5f5b6b-f868-4aeb-9d69-0b4aa92449a9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:03.014044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2c5f5b6b-f868-4aeb-9d69-0b4aa92449a9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:03.020469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c5f5b6b-f868-4aeb-9d69-0b4aa92449a9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.020941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c5f5b6b-f868-4aeb-9d69-0b4aa92449a9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.021690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c5f5b6b-f868-4aeb-9d69-0b4aa92449a9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.022120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c5f5b6b-f868-4aeb-9d69-0b4aa92449a9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.050610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2c5f5b6b-f868-4aeb-9d69-0b4aa92449a9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Mar 08 13:25:03.051146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 494/990] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:03.184534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-db24fd24-1953-48b9-8bfc-50b8d365d5d6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:03.185467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-db24fd24-1953-48b9-8bfc-50b8d365d5d6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:03.192285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db24fd24-1953-48b9-8bfc-50b8d365d5d6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.192760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db24fd24-1953-48b9-8bfc-50b8d365d5d6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.193522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db24fd24-1953-48b9-8bfc-50b8d365d5d6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.193955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db24fd24-1953-48b9-8bfc-50b8d365d5d6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.222193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-db24fd24-1953-48b9-8bfc-50b8d365d5d6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041578 Mar 08 13:25:03.222728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 497/991] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:03.234866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:03.235501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:03.241674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.242122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.242881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.243307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.305154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:03.312381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7f73e04a-7783-4d78-bea3-4fc3be758397 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081295 Mar 08 13:25:03.312968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 495/992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:03 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:03.467372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:03.467982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:03.474107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.474555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.475310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:03.475741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:03.607511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:03.616590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:03.618098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:03.619226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6b4a75f2-6aa6-419a-9a29-a84943a7de78 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155746 Mar 08 13:25:03.619780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 498/993] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:04.061998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-495b9176-ab50-4559-8e8c-225f00afad49 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:04.062933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-495b9176-ab50-4559-8e8c-225f00afad49 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:04.069393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-495b9176-ab50-4559-8e8c-225f00afad49 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.069836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-495b9176-ab50-4559-8e8c-225f00afad49 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.070595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-495b9176-ab50-4559-8e8c-225f00afad49 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.071024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-495b9176-ab50-4559-8e8c-225f00afad49 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.099033 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-495b9176-ab50-4559-8e8c-225f00afad49 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040956 Mar 08 13:25:04.099577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 496/994] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:04.233856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5214d296-6ef0-482d-b285-df06e3828f6b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:04.234700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5214d296-6ef0-482d-b285-df06e3828f6b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:04.240981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5214d296-6ef0-482d-b285-df06e3828f6b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.241421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5214d296-6ef0-482d-b285-df06e3828f6b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.242172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5214d296-6ef0-482d-b285-df06e3828f6b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.242602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5214d296-6ef0-482d-b285-df06e3828f6b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.271260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5214d296-6ef0-482d-b285-df06e3828f6b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041380 Mar 08 13:25:04.271785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 499/995] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:04.329282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:04.329892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:04.336723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.337179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.337937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.338371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.399849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:04.407099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-15ea0f8d-b04a-40e5-909c-78bd5af6bf60 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081686 Mar 08 13:25:04.407650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 497/996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:04.637774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:04.638303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:04.645000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.645516 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.646345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:04.646787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:04.777252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:04.786514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:04.788129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:04.789415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e4e180ae-c9b8-4b9a-b0d3-243a30e3104a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155646 Mar 08 13:25:04.789975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 500/997] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:05.110586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-87bdb91b-35cc-4feb-9908-5785e959fce4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:05.111487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-87bdb91b-35cc-4feb-9908-5785e959fce4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:05.117326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87bdb91b-35cc-4feb-9908-5785e959fce4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.117770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87bdb91b-35cc-4feb-9908-5785e959fce4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.118522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87bdb91b-35cc-4feb-9908-5785e959fce4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.118984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87bdb91b-35cc-4feb-9908-5785e959fce4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.146824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-87bdb91b-35cc-4feb-9908-5785e959fce4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040210 Mar 08 13:25:05.147379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 498/998] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:05.282703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-70acc901-95b1-49fb-b8a9-dcd7affc76f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:05.283823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-70acc901-95b1-49fb-b8a9-dcd7affc76f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:05.290713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70acc901-95b1-49fb-b8a9-dcd7affc76f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.291158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70acc901-95b1-49fb-b8a9-dcd7affc76f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.291908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70acc901-95b1-49fb-b8a9-dcd7affc76f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.292336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70acc901-95b1-49fb-b8a9-dcd7affc76f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.319850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-70acc901-95b1-49fb-b8a9-dcd7affc76f2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041056 Mar 08 13:25:05.320610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 501/999] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:05.424124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:05.424690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:05.431046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.431497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.432260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.432723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.493092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:05.501684 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee7f9a05-e15c-4f39-9992-58f30e453860 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081414 Mar 08 13:25:05.502262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 499/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:05.808682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:05.809296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:05.815483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.816001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.816797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:05.817235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:05.954364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:05.963464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:05.965046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:05.966195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-44444780-d597-49b8-bf31-1e16e45d5cd2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.161407 Mar 08 13:25:05.966748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 502/1001] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:06.158559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-04b38575-fa68-4600-9e40-0a24c23eeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:06.160093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-04b38575-fa68-4600-9e40-0a24c23eeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:06.166120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04b38575-fa68-4600-9e40-0a24c23eeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.166564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04b38575-fa68-4600-9e40-0a24c23eeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:06.167331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04b38575-fa68-4600-9e40-0a24c23eeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.167763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04b38575-fa68-4600-9e40-0a24c23eeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:06.196570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-04b38575-fa68-4600-9e40-0a24c23eeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041947 Mar 08 13:25:06.197248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 500/1002] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:06.332384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2f70dcf8-c950-4cd8-8548-b5e037219e7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:06.333336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2f70dcf8-c950-4cd8-8548-b5e037219e7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:06.341271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f70dcf8-c950-4cd8-8548-b5e037219e7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.341722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f70dcf8-c950-4cd8-8548-b5e037219e7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:06.342499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f70dcf8-c950-4cd8-8548-b5e037219e7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.342932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2f70dcf8-c950-4cd8-8548-b5e037219e7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:06.377197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2f70dcf8-c950-4cd8-8548-b5e037219e7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049384 Mar 08 13:25:06.377825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 503/1003] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:06.520224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:06.520865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:06.528202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.528650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:06.529453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.529917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:06.608363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:06.619125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0b82112e-bec9-4aba-9438-2b01364987f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.103292 Mar 08 13:25:06.620078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 501/1004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:06 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:06.985073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:06.985673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:06.992044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.992488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:06.993290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:06.993719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:07.123687 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:07.132570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:07.134074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:07.135228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d0cbb575-1fd1-48f0-9207-ce61ee428ced tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154172 Mar 08 13:25:07.135793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 504/1005] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:07.207979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4990f365-5c01-48bc-bfcc-c98c5678f503 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:07.208913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4990f365-5c01-48bc-bfcc-c98c5678f503 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:07.214757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4990f365-5c01-48bc-bfcc-c98c5678f503 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:07.215205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4990f365-5c01-48bc-bfcc-c98c5678f503 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:07.215961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4990f365-5c01-48bc-bfcc-c98c5678f503 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:07.216398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4990f365-5c01-48bc-bfcc-c98c5678f503 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:07.245018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4990f365-5c01-48bc-bfcc-c98c5678f503 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 Mar 08 13:25:07.245493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 502/1006] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:07.389055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-271d2aa1-a1f8-411d-bbc7-5472025b7fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:07.389961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-271d2aa1-a1f8-411d-bbc7-5472025b7fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:07.396651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-271d2aa1-a1f8-411d-bbc7-5472025b7fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:07.397129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-271d2aa1-a1f8-411d-bbc7-5472025b7fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:07.397980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-271d2aa1-a1f8-411d-bbc7-5472025b7fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:07.398413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-271d2aa1-a1f8-411d-bbc7-5472025b7fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:07.426743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-271d2aa1-a1f8-411d-bbc7-5472025b7fda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Mar 08 13:25:07.427295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 505/1007] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:07.639215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:07.639726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:07.646475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:07.646930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:07.647692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:07.648159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:07.707263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:07.714580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4b2bd1ed-8cf7-4323-9110-4d38f179f930 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079278 Mar 08 13:25:07.715146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 503/1008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:07 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:08.154691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:08.155327 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:08.161323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.161768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.162525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.162981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.255588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-313e8faf-2b38-4fda-8564-ab6c7f599778 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:08.256495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-313e8faf-2b38-4fda-8564-ab6c7f599778 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:08.262406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-313e8faf-2b38-4fda-8564-ab6c7f599778 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.264535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-313e8faf-2b38-4fda-8564-ab6c7f599778 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.264535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-313e8faf-2b38-4fda-8564-ab6c7f599778 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.264535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-313e8faf-2b38-4fda-8564-ab6c7f599778 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.295457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-313e8faf-2b38-4fda-8564-ab6c7f599778 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Mar 08 13:25:08.296050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 504/1009] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:08.298164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:08.306809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:08.308375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:08.309533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3d033ebb-c4fb-4e55-b239-f5c8160ce2e8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158819 Mar 08 13:25:08.310651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 506/1010] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:08.444329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0173add8-0273-42e3-892f-7ede1206fab2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:08.445254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0173add8-0273-42e3-892f-7ede1206fab2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:08.451002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0173add8-0273-42e3-892f-7ede1206fab2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.451448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0173add8-0273-42e3-892f-7ede1206fab2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.452205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0173add8-0273-42e3-892f-7ede1206fab2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.452637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0173add8-0273-42e3-892f-7ede1206fab2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.480610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0173add8-0273-42e3-892f-7ede1206fab2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041036 Mar 08 13:25:08.481191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 505/1011] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:08.731599 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:08.732281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:08.739090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.739529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.740295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:08.740761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:08.803311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:08.810504 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dca7ec26-1144-42c3-b6d6-69defefb31e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083028 Mar 08 13:25:08.811053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 507/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:08 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:09.307000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ef2813d4-3a06-4b56-a886-aa456c755489 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:09.307909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ef2813d4-3a06-4b56-a886-aa456c755489 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:09.314176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef2813d4-3a06-4b56-a886-aa456c755489 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.314626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef2813d4-3a06-4b56-a886-aa456c755489 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.315900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef2813d4-3a06-4b56-a886-aa456c755489 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.316335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef2813d4-3a06-4b56-a886-aa456c755489 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.327666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:09.328359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:09.335282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.335803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.336644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.337166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.345132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ef2813d4-3a06-4b56-a886-aa456c755489 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041988 Mar 08 13:25:09.345927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 506/1013] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:09.467982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:09.476437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:09.477977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:09.479155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4ecab2a3-d52e-4c4c-9d78-df9ae4c88e87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155857 Mar 08 13:25:09.479703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 508/1014] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:09.491623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cce1bb10-07de-4733-a9fb-d9c0386be974 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:09.492530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cce1bb10-07de-4733-a9fb-d9c0386be974 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:09.498696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cce1bb10-07de-4733-a9fb-d9c0386be974 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.499412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cce1bb10-07de-4733-a9fb-d9c0386be974 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.500180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cce1bb10-07de-4733-a9fb-d9c0386be974 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.500615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cce1bb10-07de-4733-a9fb-d9c0386be974 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.529487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cce1bb10-07de-4733-a9fb-d9c0386be974 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 Mar 08 13:25:09.530076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 507/1015] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:09.827708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:09.828326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:09.835654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.836095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.836894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:09.837327 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:09.899425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:09.906755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4c9c19bd-9fad-4c5c-95b5-5fb62e16203b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082936 Mar 08 13:25:09.907299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 509/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:10.357041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9403980d-e132-475e-ae85-8bd74bb1f0c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:10.358032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9403980d-e132-475e-ae85-8bd74bb1f0c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:10.364936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9403980d-e132-475e-ae85-8bd74bb1f0c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.365389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9403980d-e132-475e-ae85-8bd74bb1f0c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.366159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9403980d-e132-475e-ae85-8bd74bb1f0c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.366593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9403980d-e132-475e-ae85-8bd74bb1f0c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.394858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9403980d-e132-475e-ae85-8bd74bb1f0c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042108 Mar 08 13:25:10.395401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 508/1017] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:10.497346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:10.497947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:10.504533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.505016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.505782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.506217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.542107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-15926d84-cb6b-40ec-b367-e75f256cc7aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:10.543076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-15926d84-cb6b-40ec-b367-e75f256cc7aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:10.549553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15926d84-cb6b-40ec-b367-e75f256cc7aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.550086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15926d84-cb6b-40ec-b367-e75f256cc7aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.550905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15926d84-cb6b-40ec-b367-e75f256cc7aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.551378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-15926d84-cb6b-40ec-b367-e75f256cc7aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.582723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-15926d84-cb6b-40ec-b367-e75f256cc7aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Mar 08 13:25:10.583288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 509/1018] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:10.641768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:10.650902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:10.652471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:10.653733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1bf7f4e0-a986-4818-81ea-ec014391df32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160243 Mar 08 13:25:10.654290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 510/1019] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:10 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:10.925073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:10.925846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:10.931949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.932399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.933220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:10.933708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:10.992904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:11.000350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f9d63330-572e-4840-a87b-94711c6407cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080127 Mar 08 13:25:11.000943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 510/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:11.406760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-441eb48e-3711-4d4c-b235-ad3ea9ddb8d7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:11.407663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-441eb48e-3711-4d4c-b235-ad3ea9ddb8d7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:11.413929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-441eb48e-3711-4d4c-b235-ad3ea9ddb8d7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:11.414371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-441eb48e-3711-4d4c-b235-ad3ea9ddb8d7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:11.415153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-441eb48e-3711-4d4c-b235-ad3ea9ddb8d7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:11.415583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-441eb48e-3711-4d4c-b235-ad3ea9ddb8d7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:11.446101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-441eb48e-3711-4d4c-b235-ad3ea9ddb8d7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Mar 08 13:25:11.446647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 511/1021] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:11.593381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cb4d5eaf-a1e0-4cf7-baa5-b1d5155ce89b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:11.594276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cb4d5eaf-a1e0-4cf7-baa5-b1d5155ce89b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:11.601059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb4d5eaf-a1e0-4cf7-baa5-b1d5155ce89b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:11.601445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb4d5eaf-a1e0-4cf7-baa5-b1d5155ce89b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:11.602201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb4d5eaf-a1e0-4cf7-baa5-b1d5155ce89b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:11.602631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb4d5eaf-a1e0-4cf7-baa5-b1d5155ce89b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:11.630402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cb4d5eaf-a1e0-4cf7-baa5-b1d5155ce89b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040985 Mar 08 13:25:11.630936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 511/1022] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:11.672456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:11.673088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:11.679475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:11.679923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:11.680703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:11.681145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:11.818796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:11.826885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:11.828370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:11.829538 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-01965c91-59b0-4cb1-8bba-e4cd70b2077f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160976 Mar 08 13:25:11.830090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 512/1023] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:12.016963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:12.017596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:12.023977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.024420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.025202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.025631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.086756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:12.094219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0d348b41-79e1-4ae9-bb72-b80f83436e6a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081144 Mar 08 13:25:12.094777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 512/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:12.458382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1bad4fc9-c8b0-4472-aadb-381f4336fbc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:12.459293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1bad4fc9-c8b0-4472-aadb-381f4336fbc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:12.465545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bad4fc9-c8b0-4472-aadb-381f4336fbc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.465999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bad4fc9-c8b0-4472-aadb-381f4336fbc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.466754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bad4fc9-c8b0-4472-aadb-381f4336fbc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.467187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1bad4fc9-c8b0-4472-aadb-381f4336fbc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.494532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1bad4fc9-c8b0-4472-aadb-381f4336fbc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040743 Mar 08 13:25:12.495072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 513/1025] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:12.641955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3ad1d290-fd0b-4e74-b764-5ec0c2f9725b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:12.642784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3ad1d290-fd0b-4e74-b764-5ec0c2f9725b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:12.649161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ad1d290-fd0b-4e74-b764-5ec0c2f9725b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.649610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ad1d290-fd0b-4e74-b764-5ec0c2f9725b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.650386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ad1d290-fd0b-4e74-b764-5ec0c2f9725b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.650822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ad1d290-fd0b-4e74-b764-5ec0c2f9725b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.679746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3ad1d290-fd0b-4e74-b764-5ec0c2f9725b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041783 Mar 08 13:25:12.680370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 513/1026] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:12.849254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:12.849863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:12.855777 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.856249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.857008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:12.857439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:12.988238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:12.996324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:12.997856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:12.999240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d7cf78b9-69d8-488a-b511-6cfdac420a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154634 Mar 08 13:25:12.999793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 514/1027] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:13.111708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:13.112345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:13.118127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:13.118578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:13.119332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:13.119776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:13.177155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:13.184262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d9f3ed9f-822a-4fe6-ba97-fe6c50ff7013 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.076494 Mar 08 13:25:13.184859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 514/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:13.506769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ba05d132-06af-46cd-b5d8-c90bcbf67a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:13.507681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ba05d132-06af-46cd-b5d8-c90bcbf67a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:13.513981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba05d132-06af-46cd-b5d8-c90bcbf67a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:13.514430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba05d132-06af-46cd-b5d8-c90bcbf67a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:13.515195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba05d132-06af-46cd-b5d8-c90bcbf67a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:13.515629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba05d132-06af-46cd-b5d8-c90bcbf67a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:13.543063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ba05d132-06af-46cd-b5d8-c90bcbf67a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Mar 08 13:25:13.543605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 515/1029] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:13.691459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-84290336-d3c7-4090-afb9-857fcc5e6795 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:13.692367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-84290336-d3c7-4090-afb9-857fcc5e6795 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:13.698792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84290336-d3c7-4090-afb9-857fcc5e6795 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:13.699247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84290336-d3c7-4090-afb9-857fcc5e6795 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:13.700017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84290336-d3c7-4090-afb9-857fcc5e6795 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:13.700458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84290336-d3c7-4090-afb9-857fcc5e6795 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:13.728467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-84290336-d3c7-4090-afb9-857fcc5e6795 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041078 Mar 08 13:25:13.729052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 515/1030] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:14.017850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:14.019096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:14.025140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.025577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.026334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.026765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.159113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:14.167436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:14.169076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:14.170214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2eb276f6-e462-4765-bc59-a4e8bfac083d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156373 Mar 08 13:25:14.170758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 516/1031] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:14 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:14.201209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:14.201852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:14.208315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.214624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.214624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.214624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.268888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:14.276195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-49b17703-86af-4c5e-b877-543956efe081 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078750 Mar 08 13:25:14.276776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 516/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:14 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:14.555152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1a5bc6a3-4053-4287-9e71-a093b21b97f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:14.555955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1a5bc6a3-4053-4287-9e71-a093b21b97f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:14.562142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a5bc6a3-4053-4287-9e71-a093b21b97f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.562588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a5bc6a3-4053-4287-9e71-a093b21b97f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.563333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a5bc6a3-4053-4287-9e71-a093b21b97f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.563761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a5bc6a3-4053-4287-9e71-a093b21b97f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.590679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1a5bc6a3-4053-4287-9e71-a093b21b97f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039620 Mar 08 13:25:14.591214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 517/1033] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:14.740791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c0d7e288-c6f8-4584-8b74-8a6a250cf7e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:14.741696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c0d7e288-c6f8-4584-8b74-8a6a250cf7e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:14.747511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0d7e288-c6f8-4584-8b74-8a6a250cf7e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.747958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0d7e288-c6f8-4584-8b74-8a6a250cf7e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.748747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0d7e288-c6f8-4584-8b74-8a6a250cf7e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:14.749451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0d7e288-c6f8-4584-8b74-8a6a250cf7e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:14.776536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c0d7e288-c6f8-4584-8b74-8a6a250cf7e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040494 Mar 08 13:25:14.777108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 517/1034] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:15.189369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:15.189978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:15.196407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.196891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.197658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.198097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.293456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:15.294059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:15.299788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.300240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.301030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.301464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.327746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:15.336666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:15.338171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:15.339317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-61960af8-6818-434e-875f-1597d1affda1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153875 Mar 08 13:25:15.339874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 518/1035] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:15.359919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:15.367355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-825c3ca2-54df-442a-9665-1c44e2618ff7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077632 Mar 08 13:25:15.367921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 518/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:15 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:15.602772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eeb9326b-1b8a-49d8-9199-e057814ce8e3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:15.603601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eeb9326b-1b8a-49d8-9199-e057814ce8e3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:15.609854 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb9326b-1b8a-49d8-9199-e057814ce8e3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.610330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb9326b-1b8a-49d8-9199-e057814ce8e3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.611087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb9326b-1b8a-49d8-9199-e057814ce8e3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.611522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb9326b-1b8a-49d8-9199-e057814ce8e3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.638844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eeb9326b-1b8a-49d8-9199-e057814ce8e3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040075 Mar 08 13:25:15.639373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 519/1037] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:15.788103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7e6fd296-8c8e-4ec0-9fc6-9b0204fc6044 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:15.789036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7e6fd296-8c8e-4ec0-9fc6-9b0204fc6044 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:15.795225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e6fd296-8c8e-4ec0-9fc6-9b0204fc6044 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.795678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e6fd296-8c8e-4ec0-9fc6-9b0204fc6044 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.796438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e6fd296-8c8e-4ec0-9fc6-9b0204fc6044 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:15.796899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e6fd296-8c8e-4ec0-9fc6-9b0204fc6044 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:15.825082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7e6fd296-8c8e-4ec0-9fc6-9b0204fc6044 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 Mar 08 13:25:15.825619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 519/1038] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:16.357123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:16.357736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:16.363581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.364022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.364802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.365243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.383740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:16.384353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:16.390066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.390516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.391289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.391729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.451263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:16.459180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5ab28a9f-9ac7-4947-b189-f3a2ec86c27a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079266 Mar 08 13:25:16.459749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 520/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:16.499302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:16.507413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:16.508918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:16.510045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-74b88001-e54a-4cc9-a554-a34645e9fc37 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156790 Mar 08 13:25:16.510586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 520/1040] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:16.650287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-03360913-dd0a-4cbd-9e95-373232500c5a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:16.651117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-03360913-dd0a-4cbd-9e95-373232500c5a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:16.657125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03360913-dd0a-4cbd-9e95-373232500c5a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.657581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03360913-dd0a-4cbd-9e95-373232500c5a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.658343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03360913-dd0a-4cbd-9e95-373232500c5a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.658780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03360913-dd0a-4cbd-9e95-373232500c5a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.692320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-03360913-dd0a-4cbd-9e95-373232500c5a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046051 Mar 08 13:25:16.692918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 521/1041] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:16.837526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b4b30ce6-beb3-4375-9f07-4c86e183dc74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:16.838435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b4b30ce6-beb3-4375-9f07-4c86e183dc74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:16.844615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4b30ce6-beb3-4375-9f07-4c86e183dc74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.845099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4b30ce6-beb3-4375-9f07-4c86e183dc74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.845861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4b30ce6-beb3-4375-9f07-4c86e183dc74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:16.846297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4b30ce6-beb3-4375-9f07-4c86e183dc74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:16.873957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b4b30ce6-beb3-4375-9f07-4c86e183dc74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040399 Mar 08 13:25:16.874769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 521/1042] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:17.476231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:17.476869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:17.483140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.483590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.484344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.484808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.528541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:17.529180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:17.535881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.536517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.537354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.537791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.543694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:17.551648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-06fc4c6e-ab0e-494e-9fe0-a16288e574e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079745 Mar 08 13:25:17.552207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 522/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:17 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:17.667236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:17.676188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:17.677912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:17.679052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-911749cb-b559-48f3-a992-25c83d383b98 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154378 Mar 08 13:25:17.679604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 522/1044] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:17.703509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c4b54afc-3232-42ad-ba99-e25f8287660b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:17.704408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c4b54afc-3232-42ad-ba99-e25f8287660b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:17.710235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4b54afc-3232-42ad-ba99-e25f8287660b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.710678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4b54afc-3232-42ad-ba99-e25f8287660b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.711435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4b54afc-3232-42ad-ba99-e25f8287660b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.711864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4b54afc-3232-42ad-ba99-e25f8287660b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.739822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c4b54afc-3232-42ad-ba99-e25f8287660b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040182 Mar 08 13:25:17.740347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 523/1045] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:17.885869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3107cc77-5b98-4ac8-b059-4da83c45d6f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:17.886694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3107cc77-5b98-4ac8-b059-4da83c45d6f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:17.892945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3107cc77-5b98-4ac8-b059-4da83c45d6f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.893394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3107cc77-5b98-4ac8-b059-4da83c45d6f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.894156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3107cc77-5b98-4ac8-b059-4da83c45d6f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:17.895320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3107cc77-5b98-4ac8-b059-4da83c45d6f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:17.923091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3107cc77-5b98-4ac8-b059-4da83c45d6f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041227 Mar 08 13:25:17.923627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 523/1046] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:18.568054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:18.568678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:18.575027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.575479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.576236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.576726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.637880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:18.645672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-62aeb445-76bd-4630-ac19-7214ecbce284 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081494 Mar 08 13:25:18.646228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 524/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:18.697267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:18.697875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:18.703644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.704091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.704887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.705320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.751458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0e482c24-0bf5-47f0-a8fa-c0d145bfd557 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:18.752405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0e482c24-0bf5-47f0-a8fa-c0d145bfd557 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:18.758311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e482c24-0bf5-47f0-a8fa-c0d145bfd557 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.758755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e482c24-0bf5-47f0-a8fa-c0d145bfd557 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.759522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e482c24-0bf5-47f0-a8fa-c0d145bfd557 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.759955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e482c24-0bf5-47f0-a8fa-c0d145bfd557 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.789088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0e482c24-0bf5-47f0-a8fa-c0d145bfd557 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041812 Mar 08 13:25:18.789656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 525/1048] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:18.840180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:18.848850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:18.850398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:18.851540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-897608e1-3ef8-4277-8fea-e1873c928a7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158152 Mar 08 13:25:18.852087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 524/1049] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:18.934783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9ad6ad5a-56f8-4bbb-aab9-066796a4b2d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:18.935682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9ad6ad5a-56f8-4bbb-aab9-066796a4b2d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:18.942042 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ad6ad5a-56f8-4bbb-aab9-066796a4b2d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.942495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ad6ad5a-56f8-4bbb-aab9-066796a4b2d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.943255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ad6ad5a-56f8-4bbb-aab9-066796a4b2d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:18.943686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ad6ad5a-56f8-4bbb-aab9-066796a4b2d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:18.971743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9ad6ad5a-56f8-4bbb-aab9-066796a4b2d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041060 Mar 08 13:25:18.972287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 526/1050] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:19.661275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:19.661791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:19.668045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.668486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:19.669281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.669720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:19.728744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:19.736069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3e68d15d-3f21-4c9b-801c-9c399bf8be39 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078764 Mar 08 13:25:19.736626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 525/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:19.800282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-239d9080-7d7f-4a3f-b074-97a038a066f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:19.801832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-239d9080-7d7f-4a3f-b074-97a038a066f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:19.808199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-239d9080-7d7f-4a3f-b074-97a038a066f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.808648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-239d9080-7d7f-4a3f-b074-97a038a066f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:19.809453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-239d9080-7d7f-4a3f-b074-97a038a066f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.809891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-239d9080-7d7f-4a3f-b074-97a038a066f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:19.839781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-239d9080-7d7f-4a3f-b074-97a038a066f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Mar 08 13:25:19.840346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 527/1052] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:19.870335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:19.870935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:19.877288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.877778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:19.878527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.879166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:19.983539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0a768ac-d2de-47a1-a420-ae2717b923f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:19.985360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0a768ac-d2de-47a1-a420-ae2717b923f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:19.993218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a768ac-d2de-47a1-a420-ae2717b923f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.993706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a768ac-d2de-47a1-a420-ae2717b923f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:19.994562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a768ac-d2de-47a1-a420-ae2717b923f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:19.995077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a768ac-d2de-47a1-a420-ae2717b923f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:20.016796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:20.026052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:20.027756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:20.028948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-653520a1-13e1-4beb-b91f-8bc18d7d20be tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162616 Mar 08 13:25:20.029808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 526/1053] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:20.034106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0a768ac-d2de-47a1-a420-ae2717b923f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054525 Mar 08 13:25:20.034652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 528/1054] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:20.752942 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:20.753551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:20.760615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:20.761099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:20.761861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:20.762297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:20.821969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:20.829261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a2504a38-3997-43a3-8390-53a9726033d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080468 Mar 08 13:25:20.829816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 527/1055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:20 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:20.855397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77656059-4755-4290-968d-69027806195c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:20.856293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77656059-4755-4290-968d-69027806195c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:20.862551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77656059-4755-4290-968d-69027806195c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:20.862993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77656059-4755-4290-968d-69027806195c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:20.863746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77656059-4755-4290-968d-69027806195c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:20.864904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77656059-4755-4290-968d-69027806195c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:20.895931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77656059-4755-4290-968d-69027806195c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Mar 08 13:25:20.896482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 529/1056] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:21.045909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-46203286-588b-47cb-9042-06bb10245fb5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:21.046736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-46203286-588b-47cb-9042-06bb10245fb5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:21.046976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:21.047588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:21.052741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46203286-588b-47cb-9042-06bb10245fb5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.053193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46203286-588b-47cb-9042-06bb10245fb5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.053524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.053956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46203286-588b-47cb-9042-06bb10245fb5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.054060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.054393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46203286-588b-47cb-9042-06bb10245fb5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.054715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.055148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.083486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-46203286-588b-47cb-9042-06bb10245fb5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041008 Mar 08 13:25:21.084043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 528/1057] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:21.188003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:21.196698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:21.198206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:21.199337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-caf8f923-f42a-492d-bec1-61b4f435416b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156177 Mar 08 13:25:21.199887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 530/1058] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:21.845902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:21.853259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:21.853386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.853792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.854547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.854976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.913232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5d123481-9ff4-48ea-8de9-06f7ca033f7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:21.914447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5d123481-9ff4-48ea-8de9-06f7ca033f7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:21.919444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:21.924356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d123481-9ff4-48ea-8de9-06f7ca033f7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.924979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d123481-9ff4-48ea-8de9-06f7ca033f7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.925931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d123481-9ff4-48ea-8de9-06f7ca033f7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:21.927133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d123481-9ff4-48ea-8de9-06f7ca033f7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:21.928265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aad2d048-0097-4632-94a3-549875361785 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085603 Mar 08 13:25:21.928872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 529/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:21.964269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5d123481-9ff4-48ea-8de9-06f7ca033f7f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059930 Mar 08 13:25:21.965035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 531/1060] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:22.094726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aa171f25-c2c3-4187-a2f3-aac104e878df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:22.095630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aa171f25-c2c3-4187-a2f3-aac104e878df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:22.102292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa171f25-c2c3-4187-a2f3-aac104e878df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.102713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa171f25-c2c3-4187-a2f3-aac104e878df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:22.103480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa171f25-c2c3-4187-a2f3-aac104e878df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.103935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa171f25-c2c3-4187-a2f3-aac104e878df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:22.133509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aa171f25-c2c3-4187-a2f3-aac104e878df tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042710 Mar 08 13:25:22.134059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 530/1061] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:22.217415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:22.218019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:22.224606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.225076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:22.225947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.226449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:22.375098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:22.383947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:22.385470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:22.386651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3dcb6c7b-c889-4f1c-98ca-da88d520a13b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.173071 Mar 08 13:25:22.387206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 532/1062] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:22.945473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:22.946105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:22.952373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.952873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:22.953644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.954082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:22.977190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-65b0b75d-d0a0-45fc-abfa-ddbf873abfeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:22.978095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-65b0b75d-d0a0-45fc-abfa-ddbf873abfeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:22.984296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65b0b75d-d0a0-45fc-abfa-ddbf873abfeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.984783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65b0b75d-d0a0-45fc-abfa-ddbf873abfeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:22.985549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65b0b75d-d0a0-45fc-abfa-ddbf873abfeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:22.985980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65b0b75d-d0a0-45fc-abfa-ddbf873abfeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:23.015192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-65b0b75d-d0a0-45fc-abfa-ddbf873abfeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042234 Mar 08 13:25:23.015534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 533/1063] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:23.017449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:23.025636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0f74498f-3334-4c2b-98c2-e4b13d35dde9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084545 Mar 08 13:25:23.026217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 531/1064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:22 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:23.146641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8bbd8367-d6ee-4064-936b-6ba50ee699ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:23.147560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8bbd8367-d6ee-4064-936b-6ba50ee699ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:23.153448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bbd8367-d6ee-4064-936b-6ba50ee699ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:23.153888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bbd8367-d6ee-4064-936b-6ba50ee699ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:23.154640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bbd8367-d6ee-4064-936b-6ba50ee699ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:23.155071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bbd8367-d6ee-4064-936b-6ba50ee699ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:23.183015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8bbd8367-d6ee-4064-936b-6ba50ee699ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041085 Mar 08 13:25:23.183558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 534/1065] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:23.405969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:23.406595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:23.413794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:23.414267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:23.415121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:23.415580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:23.550081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:23.561013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:23.562639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:23.563859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d8d37625-8555-4ecc-aebf-a132961133b2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162051 Mar 08 13:25:23.564437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 532/1066] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:24.026853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-370ff84b-99d2-45aa-bc0f-3609fbe1ceed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:24.027753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-370ff84b-99d2-45aa-bc0f-3609fbe1ceed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:24.034016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-370ff84b-99d2-45aa-bc0f-3609fbe1ceed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.034459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-370ff84b-99d2-45aa-bc0f-3609fbe1ceed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.035212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-370ff84b-99d2-45aa-bc0f-3609fbe1ceed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.035642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-370ff84b-99d2-45aa-bc0f-3609fbe1ceed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.042612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:24.043227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:24.049466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.049911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.050678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.051112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.065129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-370ff84b-99d2-45aa-bc0f-3609fbe1ceed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 Mar 08 13:25:24.065680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 535/1067] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:24.113217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:24.121737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-571bcf90-635f-4d9d-a946-0de5b22f2742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082874 Mar 08 13:25:24.122299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 533/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:24.194958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3087858e-fc2b-466a-b52d-f5655ebcf677 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:24.195840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3087858e-fc2b-466a-b52d-f5655ebcf677 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:24.201883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3087858e-fc2b-466a-b52d-f5655ebcf677 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.202331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3087858e-fc2b-466a-b52d-f5655ebcf677 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.203086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3087858e-fc2b-466a-b52d-f5655ebcf677 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.203520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3087858e-fc2b-466a-b52d-f5655ebcf677 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.231822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3087858e-fc2b-466a-b52d-f5655ebcf677 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041257 Mar 08 13:25:24.232365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 536/1069] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:24.583467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:24.584035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:24.590007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.590456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.591218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:24.591653 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:24.722268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:24.731352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:24.732892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:24.734036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d8787b28-7b45-42e0-9dab-ce8e1e16484c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155239 Mar 08 13:25:24.734586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 534/1070] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:25.078721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-57daa12f-10fc-4c13-b863-5db88010cb64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:25.079743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-57daa12f-10fc-4c13-b863-5db88010cb64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:25.087071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57daa12f-10fc-4c13-b863-5db88010cb64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.087513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57daa12f-10fc-4c13-b863-5db88010cb64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.088265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57daa12f-10fc-4c13-b863-5db88010cb64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.088721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57daa12f-10fc-4c13-b863-5db88010cb64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.120853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-57daa12f-10fc-4c13-b863-5db88010cb64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Mar 08 13:25:25.121399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 537/1071] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:25.139196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:25.139830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:25.146819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.147263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.148018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.148447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.209384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:25.219196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b2d9721-5163-406f-bd60-fadf940e2614 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083748 Mar 08 13:25:25.219808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 535/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:25.245177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8c2c3723-5a52-4694-9461-6d0987de80be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:25.246218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8c2c3723-5a52-4694-9461-6d0987de80be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:25.253576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c2c3723-5a52-4694-9461-6d0987de80be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.254173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c2c3723-5a52-4694-9461-6d0987de80be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.256073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c2c3723-5a52-4694-9461-6d0987de80be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.256610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c2c3723-5a52-4694-9461-6d0987de80be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.287890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8c2c3723-5a52-4694-9461-6d0987de80be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Mar 08 13:25:25.288422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 538/1073] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:25.753817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:25.754430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:25.761219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.761666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.762429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:25.762865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:25.894281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:25.903670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:25.905202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:25.906337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-338940c1-7974-47bd-a4a7-7a6927809a1a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156418 Mar 08 13:25:25.906889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 536/1074] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:26.133259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a9fd67ea-8381-4e97-8cf2-f23deb093d20 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:26.134111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a9fd67ea-8381-4e97-8cf2-f23deb093d20 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:26.140381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9fd67ea-8381-4e97-8cf2-f23deb093d20 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.140875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9fd67ea-8381-4e97-8cf2-f23deb093d20 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:26.141633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9fd67ea-8381-4e97-8cf2-f23deb093d20 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.142063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9fd67ea-8381-4e97-8cf2-f23deb093d20 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:26.171719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a9fd67ea-8381-4e97-8cf2-f23deb093d20 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 Mar 08 13:25:26.172264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 539/1075] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:26.237039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:26.237647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:26.244172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.244613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:26.245399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.245830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:26.299757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b9ecef20-41f3-4d78-b6c7-cebe479bd420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:26.300744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b9ecef20-41f3-4d78-b6c7-cebe479bd420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:26.306748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b9ecef20-41f3-4d78-b6c7-cebe479bd420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.307221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b9ecef20-41f3-4d78-b6c7-cebe479bd420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:26.307947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:26.308072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b9ecef20-41f3-4d78-b6c7-cebe479bd420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.308462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b9ecef20-41f3-4d78-b6c7-cebe479bd420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:26.315570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b5f9c6bd-5aa4-4281-a8e4-fc39c50d545e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082595 Mar 08 13:25:26.316141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 537/1076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:26.338941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b9ecef20-41f3-4d78-b6c7-cebe479bd420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Mar 08 13:25:26.339526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 540/1077] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:26.925141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:26.925821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:26.932221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.932708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:26.933539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:26.934015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:27.065360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:27.074643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:27.076271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:27.077900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bd7ff5cf-80a7-4cd2-98f5-dd28a7c9cf3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156865 Mar 08 13:25:27.078578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 538/1078] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:27.183531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee307e63-22b1-420f-a7cf-1e3feb8b0184 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:27.184527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee307e63-22b1-420f-a7cf-1e3feb8b0184 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:27.191143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee307e63-22b1-420f-a7cf-1e3feb8b0184 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:27.191590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee307e63-22b1-420f-a7cf-1e3feb8b0184 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:27.192993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee307e63-22b1-420f-a7cf-1e3feb8b0184 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:27.193490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee307e63-22b1-420f-a7cf-1e3feb8b0184 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:27.227922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee307e63-22b1-420f-a7cf-1e3feb8b0184 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048468 Mar 08 13:25:27.228479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 541/1079] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:27.334804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:27.335539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:27.342451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:27.342981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:27.343837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:27.344352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:27.351211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5f403022-d52e-477d-952b-e683f69c86f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:27.352109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5f403022-d52e-477d-952b-e683f69c86f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:27.358153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f403022-d52e-477d-952b-e683f69c86f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:27.358595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f403022-d52e-477d-952b-e683f69c86f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:27.359358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f403022-d52e-477d-952b-e683f69c86f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:27.359788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f403022-d52e-477d-952b-e683f69c86f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:27.388172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5f403022-d52e-477d-952b-e683f69c86f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041484 Mar 08 13:25:27.388759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 542/1080] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:27.408549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:27.416979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4caebe39-8983-4125-b70e-3f44a6c022bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.086464 Mar 08 13:25:27.417527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 539/1081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:27 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:28.097284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:28.097881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:28.104085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.104534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.105320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.105756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.240226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c4a41e61-9011-4ae3-921d-9dd7c9dcd95d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:28.241047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c4a41e61-9011-4ae3-921d-9dd7c9dcd95d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:28.245973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:28.246982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4a41e61-9011-4ae3-921d-9dd7c9dcd95d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.247432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4a41e61-9011-4ae3-921d-9dd7c9dcd95d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.248237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4a41e61-9011-4ae3-921d-9dd7c9dcd95d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.248680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4a41e61-9011-4ae3-921d-9dd7c9dcd95d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.254717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:28.256252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:28.257469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-da261a88-3b71-4433-a3cc-2e87b8a251fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.164536 Mar 08 13:25:28.258025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 543/1082] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:28.276564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c4a41e61-9011-4ae3-921d-9dd7c9dcd95d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041086 Mar 08 13:25:28.278936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 540/1083] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:28.400312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c264252e-7b1f-4ec7-a51b-c70b6b9d4ca0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:28.401241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c264252e-7b1f-4ec7-a51b-c70b6b9d4ca0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:28.407174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c264252e-7b1f-4ec7-a51b-c70b6b9d4ca0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.408743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c264252e-7b1f-4ec7-a51b-c70b6b9d4ca0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.408743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c264252e-7b1f-4ec7-a51b-c70b6b9d4ca0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.409001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c264252e-7b1f-4ec7-a51b-c70b6b9d4ca0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.435044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:28.435696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:28.437538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c264252e-7b1f-4ec7-a51b-c70b6b9d4ca0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041152 Mar 08 13:25:28.438084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 544/1084] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:28.442720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.443223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.444045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:28.444507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:28.508774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:28.516043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2cb20f84-ea58-4607-be03-d5a832eec935 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085116 Mar 08 13:25:28.516595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 541/1085] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:29.277631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:29.278440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:29.286906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.287497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.287912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5b7bb3a2-f043-4828-8461-d6af47b89221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:29.288443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.288850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5b7bb3a2-f043-4828-8461-d6af47b89221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:29.289048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.294658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b7bb3a2-f043-4828-8461-d6af47b89221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.295105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b7bb3a2-f043-4828-8461-d6af47b89221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.295874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b7bb3a2-f043-4828-8461-d6af47b89221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.296304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b7bb3a2-f043-4828-8461-d6af47b89221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.325521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5b7bb3a2-f043-4828-8461-d6af47b89221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042132 Mar 08 13:25:29.326075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 542/1086] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:29.430203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:29.438457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:29.439917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:29.441082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5d6f2827-c50e-4981-b8c5-bbb2233e6619 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.168381 Mar 08 13:25:29.441630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 545/1087] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:29.449420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-77d5cbe2-c26e-430c-ab17-87a53e344ea6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:29.450345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-77d5cbe2-c26e-430c-ab17-87a53e344ea6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:29.456921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77d5cbe2-c26e-430c-ab17-87a53e344ea6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.457411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77d5cbe2-c26e-430c-ab17-87a53e344ea6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.458664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77d5cbe2-c26e-430c-ab17-87a53e344ea6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.459395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77d5cbe2-c26e-430c-ab17-87a53e344ea6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.491400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-77d5cbe2-c26e-430c-ab17-87a53e344ea6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Mar 08 13:25:29.492030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 543/1088] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:29.533503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:29.534065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:29.540417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.540903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.541659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:29.542115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:29.603310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:29.610634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7161369e-3a57-418e-8941-307d5b08541d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081170 Mar 08 13:25:29.611191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 546/1089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:29 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:30.338057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b1af6092-248f-4c79-bdcf-e28b1a041198 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:30.338881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b1af6092-248f-4c79-bdcf-e28b1a041198 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:30.344794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1af6092-248f-4c79-bdcf-e28b1a041198 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.345239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1af6092-248f-4c79-bdcf-e28b1a041198 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.346006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1af6092-248f-4c79-bdcf-e28b1a041198 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.346437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1af6092-248f-4c79-bdcf-e28b1a041198 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.376156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b1af6092-248f-4c79-bdcf-e28b1a041198 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042717 Mar 08 13:25:30.376720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 544/1090] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:30.459671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:30.460607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:30.467403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.467908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.468811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.469293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.503445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e2b10a22-6ba0-4026-a365-ab5d3c78cb76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:30.504347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e2b10a22-6ba0-4026-a365-ab5d3c78cb76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:30.510714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2b10a22-6ba0-4026-a365-ab5d3c78cb76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.511159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2b10a22-6ba0-4026-a365-ab5d3c78cb76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.511922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2b10a22-6ba0-4026-a365-ab5d3c78cb76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.512368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2b10a22-6ba0-4026-a365-ab5d3c78cb76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.541532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e2b10a22-6ba0-4026-a365-ab5d3c78cb76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 Mar 08 13:25:30.542084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 545/1091] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:30.613161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:30.621363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:30.622855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:30.623998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a8195bc1-c65c-4937-b935-ecc558777c03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.168556 Mar 08 13:25:30.624832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 547/1092] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:30.627563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:30.628171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:30.634011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.634454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.635213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:30.635646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:30.941506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:30.949308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-319a8f11-1007-48f7-9494-90c2dea0b083 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.325987 Mar 08 13:25:30.949895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 546/1093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:31.388434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9cba541f-6541-4d3a-8452-dc3351c523fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:31.389372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9cba541f-6541-4d3a-8452-dc3351c523fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:31.395140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba541f-6541-4d3a-8452-dc3351c523fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.395582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba541f-6541-4d3a-8452-dc3351c523fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:31.396340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba541f-6541-4d3a-8452-dc3351c523fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.396817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba541f-6541-4d3a-8452-dc3351c523fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:31.423540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9cba541f-6541-4d3a-8452-dc3351c523fe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039010 Mar 08 13:25:31.424081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 548/1094] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:31.552342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9ed4c90d-e0b8-4de3-9fad-e457c44976a3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:31.553303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9ed4c90d-e0b8-4de3-9fad-e457c44976a3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:31.560189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ed4c90d-e0b8-4de3-9fad-e457c44976a3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.560634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ed4c90d-e0b8-4de3-9fad-e457c44976a3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:31.561425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ed4c90d-e0b8-4de3-9fad-e457c44976a3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.561860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ed4c90d-e0b8-4de3-9fad-e457c44976a3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:31.590126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9ed4c90d-e0b8-4de3-9fad-e457c44976a3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Mar 08 13:25:31.590676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 547/1095] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:31.642502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:31.643040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:31.649688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.650143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:31.650910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.651397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:31.787792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:31.796634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:31.798153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:31.799308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4e1d257e-330e-416f-b7ff-3fd6b9b417a4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160805 Mar 08 13:25:31.799871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 549/1096] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:31.966924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:31.967556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:31.973375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.973817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:31.974567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:31.974997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:32.033605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:32.040686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a477daa-f1b3-4196-ab51-3452b46707c9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077621 Mar 08 13:25:32.041241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 548/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:31 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:32.435657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8ba2be16-d822-4728-8182-116558957f54 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:32.436559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8ba2be16-d822-4728-8182-116558957f54 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:32.442554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ba2be16-d822-4728-8182-116558957f54 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:32.442999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ba2be16-d822-4728-8182-116558957f54 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:32.443752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ba2be16-d822-4728-8182-116558957f54 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:32.444200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ba2be16-d822-4728-8182-116558957f54 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:32.471508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8ba2be16-d822-4728-8182-116558957f54 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039864 Mar 08 13:25:32.472054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 550/1098] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:32.604163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-56b8bec2-abea-4665-9cf7-dda545bcb166 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:32.605029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-56b8bec2-abea-4665-9cf7-dda545bcb166 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:32.610888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56b8bec2-abea-4665-9cf7-dda545bcb166 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:32.611613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56b8bec2-abea-4665-9cf7-dda545bcb166 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:32.612372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56b8bec2-abea-4665-9cf7-dda545bcb166 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:32.612855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56b8bec2-abea-4665-9cf7-dda545bcb166 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:32.641195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-56b8bec2-abea-4665-9cf7-dda545bcb166 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041795 Mar 08 13:25:32.641729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 549/1099] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:32.818208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:32.818810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:32.825859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:32.826309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:32.827060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:32.827494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:32.966796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:32.974928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:32.976672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:32.977829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ac90dfe8-a77b-4de7-9095-479427f2fc6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163563 Mar 08 13:25:32.978386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 551/1100] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:32 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:33.057604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:33.058206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:33.064088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:33.064529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:33.065314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:33.065742 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:33.126403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:33.134339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-09801534-e2c0-4828-8199-602b724a5b66 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081194 Mar 08 13:25:33.134885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 550/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:33 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:33.483587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-97e37907-e14f-49df-b033-a4aaf52b7251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:33.484520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-97e37907-e14f-49df-b033-a4aaf52b7251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:33.490384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97e37907-e14f-49df-b033-a4aaf52b7251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:33.490831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97e37907-e14f-49df-b033-a4aaf52b7251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:33.492228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97e37907-e14f-49df-b033-a4aaf52b7251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:33.492676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97e37907-e14f-49df-b033-a4aaf52b7251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:33.520100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-97e37907-e14f-49df-b033-a4aaf52b7251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040522 Mar 08 13:25:33.520638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 552/1102] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:33.653172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ebeb993d-ef59-43ec-acdc-83dafab63a49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:33.654003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ebeb993d-ef59-43ec-acdc-83dafab63a49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:33.660221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebeb993d-ef59-43ec-acdc-83dafab63a49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:33.660683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebeb993d-ef59-43ec-acdc-83dafab63a49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:33.661445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebeb993d-ef59-43ec-acdc-83dafab63a49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:33.661875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebeb993d-ef59-43ec-acdc-83dafab63a49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:33.689510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ebeb993d-ef59-43ec-acdc-83dafab63a49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040334 Mar 08 13:25:33.690044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 551/1103] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:33.997046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:33.997656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:34.004040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.004486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.005343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.005784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.139280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:34.148930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:34.150504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:34.151748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-198ce084-cb8b-4844-9411-3b3198ce6709 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158660 Mar 08 13:25:34.152366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 553/1104] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:34.153728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:34.154363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:34.160283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.160765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.161528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.161962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.220532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:34.228467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-68a7cd00-5632-4185-8c39-eb0d9e3089a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078774 Mar 08 13:25:34.229058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 552/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:34 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:34.532960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40921184-cdb1-4718-8563-5f892525e757 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:34.534059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40921184-cdb1-4718-8563-5f892525e757 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:34.541995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40921184-cdb1-4718-8563-5f892525e757 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.542530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40921184-cdb1-4718-8563-5f892525e757 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.543463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40921184-cdb1-4718-8563-5f892525e757 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.544032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40921184-cdb1-4718-8563-5f892525e757 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.575079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40921184-cdb1-4718-8563-5f892525e757 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047076 Mar 08 13:25:34.575743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 554/1106] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:34.702104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4b8586aa-aff0-4a2b-b932-9b8e52a2d492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:34.703097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4b8586aa-aff0-4a2b-b932-9b8e52a2d492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:34.709837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4b8586aa-aff0-4a2b-b932-9b8e52a2d492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.710961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4b8586aa-aff0-4a2b-b932-9b8e52a2d492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.711849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4b8586aa-aff0-4a2b-b932-9b8e52a2d492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:34.712325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4b8586aa-aff0-4a2b-b932-9b8e52a2d492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:34.741792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4b8586aa-aff0-4a2b-b932-9b8e52a2d492 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Mar 08 13:25:34.742368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 553/1107] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:35.170367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:35.170974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:35.177231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.177681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.178483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.178941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.245656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:35.246293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:35.252549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.253077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.253889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.254337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.318452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:35.323963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:35.326945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a1d9eb90-74cb-4365-a8a4-88185fcac7a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085723 Mar 08 13:25:35.327598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 554/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:35 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:35.332725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:35.334402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:35.335701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-968b4f59-d535-4d87-8a31-01349974fe4d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.169225 Mar 08 13:25:35.336368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 555/1109] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:35.587269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-24717c60-80c8-49b6-8089-bdc3b2c61f04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:35.588223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-24717c60-80c8-49b6-8089-bdc3b2c61f04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:35.594616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24717c60-80c8-49b6-8089-bdc3b2c61f04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.595070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24717c60-80c8-49b6-8089-bdc3b2c61f04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.595868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24717c60-80c8-49b6-8089-bdc3b2c61f04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.596352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24717c60-80c8-49b6-8089-bdc3b2c61f04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.626304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-24717c60-80c8-49b6-8089-bdc3b2c61f04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Mar 08 13:25:35.626855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 555/1110] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:35.755132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f03217c3-af7e-4653-9e31-58ee39fe99b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:35.756280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f03217c3-af7e-4653-9e31-58ee39fe99b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:35.763491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f03217c3-af7e-4653-9e31-58ee39fe99b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.764038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f03217c3-af7e-4653-9e31-58ee39fe99b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.764992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f03217c3-af7e-4653-9e31-58ee39fe99b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:35.765540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f03217c3-af7e-4653-9e31-58ee39fe99b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:35.795684 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f03217c3-af7e-4653-9e31-58ee39fe99b4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Mar 08 13:25:35.796368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 556/1111] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:36.343495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:36.344062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:36.354132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:36.354790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:36.354903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.355414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.356295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.356785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.361383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.361855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.362685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.363144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.425260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:36.432891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-50e7c4be-0c23-440d-a320-a57e90d661d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.093364 Mar 08 13:25:36.433473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 556/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:36 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:36.497175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:36.505542 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:36.507019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:36.508885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-75456960-eea0-4e8c-81a4-f9829aa45520 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158855 Mar 08 13:25:36.509442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 557/1113] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:36.639292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2ffb0592-cb98-4013-a6dd-2dc8e4cc69f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:36.640311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2ffb0592-cb98-4013-a6dd-2dc8e4cc69f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:36.646924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ffb0592-cb98-4013-a6dd-2dc8e4cc69f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.647469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ffb0592-cb98-4013-a6dd-2dc8e4cc69f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.648351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ffb0592-cb98-4013-a6dd-2dc8e4cc69f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.648820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ffb0592-cb98-4013-a6dd-2dc8e4cc69f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.676432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2ffb0592-cb98-4013-a6dd-2dc8e4cc69f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Mar 08 13:25:36.677128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 557/1114] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:36.807416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7d1c753b-a67b-47fc-b89f-a175f4020a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:36.808360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7d1c753b-a67b-47fc-b89f-a175f4020a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:36.814092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d1c753b-a67b-47fc-b89f-a175f4020a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.818637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d1c753b-a67b-47fc-b89f-a175f4020a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.818637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d1c753b-a67b-47fc-b89f-a175f4020a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:36.818637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d1c753b-a67b-47fc-b89f-a175f4020a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:36.843959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7d1c753b-a67b-47fc-b89f-a175f4020a84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040921 Mar 08 13:25:36.844515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 558/1115] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:37.450435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:37.451034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:37.457296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.457749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.458526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.458961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.518005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:37.525334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0ab2a9ae-5101-4743-b76c-c4bf2e44f02b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078825 Mar 08 13:25:37.525887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 558/1116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:37 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:37.527525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:37.528128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:37.534349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.534789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.535544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.535977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.674602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:37.683419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:37.684942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:37.686103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c3f06e83-dcc0-43b0-9b11-3d25ba4ab558 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162763 Mar 08 13:25:37.686651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 559/1117] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:37 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:37.688881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e9fdc01e-3f0d-4a61-a3cf-6fcfeea1d806 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:37.689823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e9fdc01e-3f0d-4a61-a3cf-6fcfeea1d806 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:37.696152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9fdc01e-3f0d-4a61-a3cf-6fcfeea1d806 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.696601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9fdc01e-3f0d-4a61-a3cf-6fcfeea1d806 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.697406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9fdc01e-3f0d-4a61-a3cf-6fcfeea1d806 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.697845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9fdc01e-3f0d-4a61-a3cf-6fcfeea1d806 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.726145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e9fdc01e-3f0d-4a61-a3cf-6fcfeea1d806 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Mar 08 13:25:37.727571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 559/1118] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:37.856557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7839add0-d79e-4afb-9a70-7c94d3db6025 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:37.857497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7839add0-d79e-4afb-9a70-7c94d3db6025 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:37.863336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7839add0-d79e-4afb-9a70-7c94d3db6025 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.863783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7839add0-d79e-4afb-9a70-7c94d3db6025 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.864543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7839add0-d79e-4afb-9a70-7c94d3db6025 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:37.865016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7839add0-d79e-4afb-9a70-7c94d3db6025 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:37.894455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7839add0-d79e-4afb-9a70-7c94d3db6025 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042880 Mar 08 13:25:37.894957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 560/1119] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:38.542042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:38.542683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:38.549062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.549512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.550270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.550708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.610513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:38.618574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c55ceb55-3e05-46a7-83ed-3aaeea6849a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080920 Mar 08 13:25:38.619349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 560/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:38 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:38.704668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:38.705348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:38.713350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.713811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.714638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.715101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.739764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3003ae59-58ca-40ff-8549-fdc7c36b2930 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:38.740718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3003ae59-58ca-40ff-8549-fdc7c36b2930 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:38.747102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3003ae59-58ca-40ff-8549-fdc7c36b2930 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.747561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3003ae59-58ca-40ff-8549-fdc7c36b2930 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.748336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3003ae59-58ca-40ff-8549-fdc7c36b2930 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.748802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3003ae59-58ca-40ff-8549-fdc7c36b2930 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.782766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3003ae59-58ca-40ff-8549-fdc7c36b2930 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047989 Mar 08 13:25:38.783553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 561/1121] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:38.871689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:38.880178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:38.881695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:38.882876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-83ee8309-253d-4b64-8600-b09d958a6a3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.182296 Mar 08 13:25:38.883708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 561/1122] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:38 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:38.905474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4fc03a56-8235-4a0b-9b38-cd2ab23ac2f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:38.906379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4fc03a56-8235-4a0b-9b38-cd2ab23ac2f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:38.912212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fc03a56-8235-4a0b-9b38-cd2ab23ac2f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.912681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fc03a56-8235-4a0b-9b38-cd2ab23ac2f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.913450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fc03a56-8235-4a0b-9b38-cd2ab23ac2f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:38.913883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fc03a56-8235-4a0b-9b38-cd2ab23ac2f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:38.941790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4fc03a56-8235-4a0b-9b38-cd2ab23ac2f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040194 Mar 08 13:25:38.942320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 562/1123] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:39.640403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:39.640962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:39.646850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.647300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.648065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.649003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.708649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:39.716983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f1a913a4-85bd-4b20-ad46-810cb6050e61 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080487 Mar 08 13:25:39.717540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 562/1124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:39 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:39.794714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5310cf59-e87f-40f0-9046-9d5e26898d01 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:39.795610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5310cf59-e87f-40f0-9046-9d5e26898d01 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:39.801926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5310cf59-e87f-40f0-9046-9d5e26898d01 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.802371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5310cf59-e87f-40f0-9046-9d5e26898d01 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.803123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5310cf59-e87f-40f0-9046-9d5e26898d01 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.803549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5310cf59-e87f-40f0-9046-9d5e26898d01 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.831574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5310cf59-e87f-40f0-9046-9d5e26898d01 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040887 Mar 08 13:25:39.832104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 563/1125] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:39.902467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:39.903038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:39.908951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.909396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.910288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.910752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.953323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cab9d2b0-d22a-48fc-a707-6193b680e27b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:39.954265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cab9d2b0-d22a-48fc-a707-6193b680e27b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:39.960186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cab9d2b0-d22a-48fc-a707-6193b680e27b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.960690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cab9d2b0-d22a-48fc-a707-6193b680e27b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.961508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cab9d2b0-d22a-48fc-a707-6193b680e27b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:39.961944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cab9d2b0-d22a-48fc-a707-6193b680e27b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:39.990538 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cab9d2b0-d22a-48fc-a707-6193b680e27b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Mar 08 13:25:39.991100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 564/1126] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:40.053595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:40.062433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:40.063966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:40.065153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a7599a9-ca2a-4ca1-901d-77321b364390 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.167378 Mar 08 13:25:40.065707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 563/1127] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:40.733667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:40.734276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:40.740118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:40.740567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:40.741355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:40.741790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:40.800838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:40.809801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d7abb1f0-06a6-4dec-a60f-7080eb65b7bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079975 Mar 08 13:25:40.810355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 565/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:40 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:40.842899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1a2be3fe-8888-412d-9d4b-0f8c93a60ec5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:40.843797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1a2be3fe-8888-412d-9d4b-0f8c93a60ec5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:40.849983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a2be3fe-8888-412d-9d4b-0f8c93a60ec5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:40.853320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a2be3fe-8888-412d-9d4b-0f8c93a60ec5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:40.853320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a2be3fe-8888-412d-9d4b-0f8c93a60ec5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:40.853320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a2be3fe-8888-412d-9d4b-0f8c93a60ec5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:40.880438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1a2be3fe-8888-412d-9d4b-0f8c93a60ec5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Mar 08 13:25:40.881021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 564/1129] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:41.003009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-66a048e0-8860-43b0-aa7b-53bc258f03e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:41.003872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-66a048e0-8860-43b0-aa7b-53bc258f03e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:41.009774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66a048e0-8860-43b0-aa7b-53bc258f03e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.010224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66a048e0-8860-43b0-aa7b-53bc258f03e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.010990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66a048e0-8860-43b0-aa7b-53bc258f03e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.011469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66a048e0-8860-43b0-aa7b-53bc258f03e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.040329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-66a048e0-8860-43b0-aa7b-53bc258f03e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 Mar 08 13:25:41.040924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 566/1130] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:41.083123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:41.083720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:41.090212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.090698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.091587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.092067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.220401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:41.229286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:41.230778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:41.231924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-31d8e0b8-c55d-401d-aa2d-9823898a9adb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152671 Mar 08 13:25:41.232539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 565/1131] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:41.827081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:41.827693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:41.834130 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.834577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.835334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.835770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.892040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-53465b92-eb4d-4dcf-a493-f22ce91c574a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:41.893422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-53465b92-eb4d-4dcf-a493-f22ce91c574a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:41.901841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53465b92-eb4d-4dcf-a493-f22ce91c574a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.902251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:41.902409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53465b92-eb4d-4dcf-a493-f22ce91c574a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.903275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53465b92-eb4d-4dcf-a493-f22ce91c574a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:41.903792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53465b92-eb4d-4dcf-a493-f22ce91c574a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:41.910010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8e089957-a92b-4877-84ed-fb2bb45f964d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.086758 Mar 08 13:25:41.910817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 567/1132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:41.933357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-53465b92-eb4d-4dcf-a493-f22ce91c574a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Mar 08 13:25:41.933913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 566/1133] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:42.051453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-83547397-e392-4cff-bfbf-156fe2ff29a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:42.052394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-83547397-e392-4cff-bfbf-156fe2ff29a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:42.058790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83547397-e392-4cff-bfbf-156fe2ff29a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.059229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83547397-e392-4cff-bfbf-156fe2ff29a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.060014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83547397-e392-4cff-bfbf-156fe2ff29a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.060440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83547397-e392-4cff-bfbf-156fe2ff29a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.087768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-83547397-e392-4cff-bfbf-156fe2ff29a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040196 Mar 08 13:25:42.088233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 568/1134] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:42.250375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:42.250973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:42.256841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.257289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.258153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.258586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.389375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:42.397528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:42.399015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:42.400396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c56800f1-504f-4501-91bb-97e5e731f27d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154180 Mar 08 13:25:42.400973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 567/1135] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:42.660494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:25:42.660743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:25:42.927491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:42.928480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:42.935644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.936085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.936935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.937371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.944947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-43271ac5-939e-424c-b21c-57a1a469904d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:42.945847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-43271ac5-939e-424c-b21c-57a1a469904d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:42.953059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43271ac5-939e-424c-b21c-57a1a469904d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.953506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43271ac5-939e-424c-b21c-57a1a469904d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.954260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43271ac5-939e-424c-b21c-57a1a469904d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:42.954696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43271ac5-939e-424c-b21c-57a1a469904d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:42.993690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-43271ac5-939e-424c-b21c-57a1a469904d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052601 Mar 08 13:25:42.994295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 568/1136] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:43.002621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:43.010745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-12bae960-9e49-4660-a1eb-bbe06d384723 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087521 Mar 08 13:25:43.014247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 569/1137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:43.099461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e56e160e-3a70-4f16-b80e-2c3cd5010fae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:43.100648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e56e160e-3a70-4f16-b80e-2c3cd5010fae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:43.106572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e56e160e-3a70-4f16-b80e-2c3cd5010fae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:43.107016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e56e160e-3a70-4f16-b80e-2c3cd5010fae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:43.107768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e56e160e-3a70-4f16-b80e-2c3cd5010fae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:43.108199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e56e160e-3a70-4f16-b80e-2c3cd5010fae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:43.139995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e56e160e-3a70-4f16-b80e-2c3cd5010fae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Mar 08 13:25:43.140552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 569/1138] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:43.419120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:43.419719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:43.425635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:43.426090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:43.426843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:43.427276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:43.556296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:43.564401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:43.565924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:43.567055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e58c1471-af44-4baf-8d5a-0de29df56789 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152407 Mar 08 13:25:43.567600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 570/1139] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:44.005643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-86cc07ab-e7c6-4d02-9394-ffdcc3b5ca2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:44.006546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-86cc07ab-e7c6-4d02-9394-ffdcc3b5ca2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:44.013381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86cc07ab-e7c6-4d02-9394-ffdcc3b5ca2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.013839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86cc07ab-e7c6-4d02-9394-ffdcc3b5ca2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.014588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86cc07ab-e7c6-4d02-9394-ffdcc3b5ca2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.015019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86cc07ab-e7c6-4d02-9394-ffdcc3b5ca2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.028965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:44.029686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:44.035889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.036335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.037115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.037546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.044890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-86cc07ab-e7c6-4d02-9394-ffdcc3b5ca2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Mar 08 13:25:44.045496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 570/1140] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:44.096360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:44.103878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-768b09c0-0b4c-4979-b6fc-6c79c009000f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078648 Mar 08 13:25:44.104437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 571/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:44 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:44.151575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4136320e-9874-4bdb-90cb-65d3a8698a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:44.152470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4136320e-9874-4bdb-90cb-65d3a8698a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:44.158322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4136320e-9874-4bdb-90cb-65d3a8698a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.158772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4136320e-9874-4bdb-90cb-65d3a8698a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.159523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4136320e-9874-4bdb-90cb-65d3a8698a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.159951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4136320e-9874-4bdb-90cb-65d3a8698a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.187865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4136320e-9874-4bdb-90cb-65d3a8698a57 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040422 Mar 08 13:25:44.188407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 571/1142] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:44.586197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:44.586988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:44.592889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.593326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.594083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:44.594514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:44.730331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:44.738432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:44.739921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:44.741091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c35a53bd-dc43-4637-9441-59f80bf5c02c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158774 Mar 08 13:25:44.741647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 572/1143] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:45.057552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b229f4d9-9ec9-496b-b14e-1923ebf7b148 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:45.058457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b229f4d9-9ec9-496b-b14e-1923ebf7b148 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:45.064351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b229f4d9-9ec9-496b-b14e-1923ebf7b148 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.064845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b229f4d9-9ec9-496b-b14e-1923ebf7b148 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.065616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b229f4d9-9ec9-496b-b14e-1923ebf7b148 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.066054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b229f4d9-9ec9-496b-b14e-1923ebf7b148 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.094273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b229f4d9-9ec9-496b-b14e-1923ebf7b148 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041539 Mar 08 13:25:45.094859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 572/1144] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:45.121276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:45.121884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:45.128210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.128678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.129428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.129857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.189976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:45.198545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c47d69e1-67fd-4046-9f9b-83e55ddd50f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081816 Mar 08 13:25:45.199116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 573/1145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:45 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:45.200114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-79ab57e0-fd0d-44b1-9916-562ee77c534c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:45.201052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79ab57e0-fd0d-44b1-9916-562ee77c534c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:45.207198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ab57e0-fd0d-44b1-9916-562ee77c534c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.207643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ab57e0-fd0d-44b1-9916-562ee77c534c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.208441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ab57e0-fd0d-44b1-9916-562ee77c534c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.208985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79ab57e0-fd0d-44b1-9916-562ee77c534c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.237084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-79ab57e0-fd0d-44b1-9916-562ee77c534c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041466 Mar 08 13:25:45.237632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 573/1146] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:45.760906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:45.761514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:45.767345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.767789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.768543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:45.768999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:45.901057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:45.909177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:45.910656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:45.911779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-301cc909-01e8-4c3a-a86d-dde7fd55d18a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155644 Mar 08 13:25:45.912325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 574/1147] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:46.106000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e47f1bcd-118e-43f4-9f7a-a5dbde1eb5cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:46.106817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e47f1bcd-118e-43f4-9f7a-a5dbde1eb5cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:46.113107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e47f1bcd-118e-43f4-9f7a-a5dbde1eb5cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.113553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e47f1bcd-118e-43f4-9f7a-a5dbde1eb5cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:46.114309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e47f1bcd-118e-43f4-9f7a-a5dbde1eb5cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.114741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e47f1bcd-118e-43f4-9f7a-a5dbde1eb5cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:46.142766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e47f1bcd-118e-43f4-9f7a-a5dbde1eb5cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041397 Mar 08 13:25:46.143316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 574/1148] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:46.215290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:46.215929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:46.222083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.222529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:46.223281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.223706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:46.248577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8ccd5084-9569-4947-97f3-3ebf3020c4c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:46.249534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8ccd5084-9569-4947-97f3-3ebf3020c4c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:46.255799 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ccd5084-9569-4947-97f3-3ebf3020c4c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.256248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ccd5084-9569-4947-97f3-3ebf3020c4c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:46.257047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ccd5084-9569-4947-97f3-3ebf3020c4c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.257491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ccd5084-9569-4947-97f3-3ebf3020c4c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:46.282983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:46.291478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-08f3be9a-09e2-4b74-b68a-3478e017bda6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080194 Mar 08 13:25:46.291672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8ccd5084-9569-4947-97f3-3ebf3020c4c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Mar 08 13:25:46.292437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 575/1149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:46.292596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 575/1150] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:46.929743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:46.930370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:46.936506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.936981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:46.937797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:46.938219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:47.070191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:47.078868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:47.080367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:47.081552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f8c6d73c-c79d-444c-a5da-59f7e4eaa7fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155811 Mar 08 13:25:47.082126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 576/1151] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:47.154561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-30cc855e-8a6a-4602-b669-49033cdae17b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:47.155497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-30cc855e-8a6a-4602-b669-49033cdae17b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:47.161815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30cc855e-8a6a-4602-b669-49033cdae17b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:47.162259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30cc855e-8a6a-4602-b669-49033cdae17b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:47.163013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30cc855e-8a6a-4602-b669-49033cdae17b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:47.163440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30cc855e-8a6a-4602-b669-49033cdae17b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:47.191710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-30cc855e-8a6a-4602-b669-49033cdae17b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041094 Mar 08 13:25:47.192176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 576/1152] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:47.302960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2fadc0c7-3cf1-43e6-ae4f-28f267eff30a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:47.303976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2fadc0c7-3cf1-43e6-ae4f-28f267eff30a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:47.308714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:47.309335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:47.310441 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fadc0c7-3cf1-43e6-ae4f-28f267eff30a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:47.310894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fadc0c7-3cf1-43e6-ae4f-28f267eff30a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:47.311664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fadc0c7-3cf1-43e6-ae4f-28f267eff30a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:47.312103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fadc0c7-3cf1-43e6-ae4f-28f267eff30a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:47.315108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:47.315563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:47.316357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:47.316833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:47.342205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2fadc0c7-3cf1-43e6-ae4f-28f267eff30a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Mar 08 13:25:47.346758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 577/1153] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:47.381234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:47.389007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eeff8532-4972-459c-9e62-1e5e156cf3b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084573 Mar 08 13:25:47.389571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 577/1154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:48.100212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:48.100775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:48.107112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.107561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.108322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.108784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.203037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-59374249-8dd9-46a6-985c-3719bfd8cbfb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:48.204560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-59374249-8dd9-46a6-985c-3719bfd8cbfb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:48.210997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59374249-8dd9-46a6-985c-3719bfd8cbfb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.211449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59374249-8dd9-46a6-985c-3719bfd8cbfb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.212239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59374249-8dd9-46a6-985c-3719bfd8cbfb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.212703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59374249-8dd9-46a6-985c-3719bfd8cbfb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.241555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-59374249-8dd9-46a6-985c-3719bfd8cbfb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Mar 08 13:25:48.242113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 578/1155] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:48.246671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:48.255402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:48.256944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:48.258095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-741fe540-a221-45af-8fff-a7ce4110d204 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162064 Mar 08 13:25:48.258676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 578/1156] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:48 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:48.355003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7c486285-e553-4a83-9aec-7c2850839c88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:48.355894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7c486285-e553-4a83-9aec-7c2850839c88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:48.362247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c486285-e553-4a83-9aec-7c2850839c88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.362696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c486285-e553-4a83-9aec-7c2850839c88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.363456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c486285-e553-4a83-9aec-7c2850839c88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.363890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c486285-e553-4a83-9aec-7c2850839c88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.391752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7c486285-e553-4a83-9aec-7c2850839c88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 Mar 08 13:25:48.392295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 579/1157] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:48.405633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:48.406242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:48.412459 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.412930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.413691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:48.414126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:48.475296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:48.483660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ef02ec46-2e09-4bb0-b2f1-ed807fa1d7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081834 Mar 08 13:25:48.484234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 579/1158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:48 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:49.253939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8f638c4a-2783-4e4c-8801-a6947f0d9d00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:49.254871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8f638c4a-2783-4e4c-8801-a6947f0d9d00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:49.261252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f638c4a-2783-4e4c-8801-a6947f0d9d00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.261698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f638c4a-2783-4e4c-8801-a6947f0d9d00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.262457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f638c4a-2783-4e4c-8801-a6947f0d9d00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.262890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f638c4a-2783-4e4c-8801-a6947f0d9d00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.275693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:49.276303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:49.282079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.282527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.283290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.283724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.292527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8f638c4a-2783-4e4c-8801-a6947f0d9d00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 Mar 08 13:25:49.293117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 580/1159] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:49.404118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3ce22a33-c69d-46c3-9973-a3d1bc1e2ae3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:49.405060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3ce22a33-c69d-46c3-9973-a3d1bc1e2ae3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:49.410791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ce22a33-c69d-46c3-9973-a3d1bc1e2ae3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.411313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ce22a33-c69d-46c3-9973-a3d1bc1e2ae3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.411986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ce22a33-c69d-46c3-9973-a3d1bc1e2ae3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.412419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ce22a33-c69d-46c3-9973-a3d1bc1e2ae3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.413774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:49.423014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:49.424514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:49.426144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-667ef24b-d1ef-43fd-a1ce-189826cc1eaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154845 Mar 08 13:25:49.426994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 580/1160] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:49.442235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3ce22a33-c69d-46c3-9973-a3d1bc1e2ae3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 Mar 08 13:25:49.442769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 581/1161] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:49.595156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:49.597038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:49.601715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.602115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.603579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:49.604014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:49.662746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:49.670490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c745c794-6432-4262-b743-110007d34e55 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.174777 Mar 08 13:25:49.671041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 581/1162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:49 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:50.304653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dd92fe7b-ef76-47f8-8996-675e3153fda5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:50.305538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dd92fe7b-ef76-47f8-8996-675e3153fda5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:50.311892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd92fe7b-ef76-47f8-8996-675e3153fda5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.312344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd92fe7b-ef76-47f8-8996-675e3153fda5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.313143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd92fe7b-ef76-47f8-8996-675e3153fda5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.313579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd92fe7b-ef76-47f8-8996-675e3153fda5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.450545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:50.451335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:50.458661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.459102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.459873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.460301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.498083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dd92fe7b-ef76-47f8-8996-675e3153fda5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197759 Mar 08 13:25:50.498683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 582/1163] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:50.503641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-841017be-e332-44d3-88d1-ef717c8a7eab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:50.504753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-841017be-e332-44d3-88d1-ef717c8a7eab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:50.511085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-841017be-e332-44d3-88d1-ef717c8a7eab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.511085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-841017be-e332-44d3-88d1-ef717c8a7eab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.511876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-841017be-e332-44d3-88d1-ef717c8a7eab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.512312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-841017be-e332-44d3-88d1-ef717c8a7eab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.541283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-841017be-e332-44d3-88d1-ef717c8a7eab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041553 Mar 08 13:25:50.541818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 583/1164] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:50.601244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:50.610237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:50.611732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:50.612911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-313d51b3-42b7-4aa9-b084-9532fcddca7c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.166397 Mar 08 13:25:50.613498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 582/1165] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:50.687781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:50.688408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:50.694416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.695061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.695821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:50.696324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:50.754654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:50.762522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a9cff0f-5b7a-447f-9c4e-52110f41600f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078630 Mar 08 13:25:50.763064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 584/1166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:51.509544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-72311792-0b63-4c81-95c0-e7213cac9af3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:51.510523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-72311792-0b63-4c81-95c0-e7213cac9af3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:51.516802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72311792-0b63-4c81-95c0-e7213cac9af3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.517248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72311792-0b63-4c81-95c0-e7213cac9af3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.517997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72311792-0b63-4c81-95c0-e7213cac9af3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.518428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-72311792-0b63-4c81-95c0-e7213cac9af3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.548142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-72311792-0b63-4c81-95c0-e7213cac9af3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Mar 08 13:25:51.548895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 583/1167] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:51.552403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2c1c68bd-a89b-4d28-8ad9-c518d1145c35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:51.553342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2c1c68bd-a89b-4d28-8ad9-c518d1145c35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:51.560148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1c68bd-a89b-4d28-8ad9-c518d1145c35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.560604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1c68bd-a89b-4d28-8ad9-c518d1145c35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.561407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1c68bd-a89b-4d28-8ad9-c518d1145c35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.561852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1c68bd-a89b-4d28-8ad9-c518d1145c35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.589566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2c1c68bd-a89b-4d28-8ad9-c518d1145c35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041041 Mar 08 13:25:51.590102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 585/1168] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:51.632041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:51.632590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:51.639064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.639511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.640266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.640715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.769371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:51.778048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:51.779390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:51.779614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:51.779995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:51.780797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-843be24e-5693-4135-a243-03fd6a4526cd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152582 Mar 08 13:25:51.781346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 584/1169] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:51.785697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.786143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.786903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:51.787335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:51.844915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:51.852146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-51409cbf-5a9f-46e5-aa3c-08847fdb09ce tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.076648 Mar 08 13:25:51.855870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 586/1170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:51.967396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:25:51.967613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:25:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:25:52.560243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3d3f163e-40a8-4ed8-8aa0-7c960e70d77e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:52.561276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3d3f163e-40a8-4ed8-8aa0-7c960e70d77e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:52.567567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d3f163e-40a8-4ed8-8aa0-7c960e70d77e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.568019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d3f163e-40a8-4ed8-8aa0-7c960e70d77e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.568810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d3f163e-40a8-4ed8-8aa0-7c960e70d77e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.569245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d3f163e-40a8-4ed8-8aa0-7c960e70d77e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.597752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3d3f163e-40a8-4ed8-8aa0-7c960e70d77e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Mar 08 13:25:52.598389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 585/1171] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:52.601116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0a5ff2d-19a8-4b8d-ab53-11bf113bdd87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:52.602056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0a5ff2d-19a8-4b8d-ab53-11bf113bdd87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:52.609118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a5ff2d-19a8-4b8d-ab53-11bf113bdd87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.609595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a5ff2d-19a8-4b8d-ab53-11bf113bdd87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.610359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a5ff2d-19a8-4b8d-ab53-11bf113bdd87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.610794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0a5ff2d-19a8-4b8d-ab53-11bf113bdd87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.639000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0a5ff2d-19a8-4b8d-ab53-11bf113bdd87 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042046 Mar 08 13:25:52.639541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 587/1172] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:52.798049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:52.798652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:52.804470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.804962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.806506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.806947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.871566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:52.872308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:52.878355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.878807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.879574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:52.880008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:52.939618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:52.947993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-51902b63-d7e1-4444-a033-f098bb34c09c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081242 Mar 08 13:25:52.948565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 588/1173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:52 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:25:52.949061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:52.957641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:52.959139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:52.960337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bc7ea3bd-90af-4ef7-98c0-bcde736133ad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.166239 Mar 08 13:25:52.960966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 586/1174] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:53.609366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e52aed47-1df8-4fcf-86bd-d44661871e89 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:53.610216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e52aed47-1df8-4fcf-86bd-d44661871e89 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:53.616386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52aed47-1df8-4fcf-86bd-d44661871e89 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.616870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52aed47-1df8-4fcf-86bd-d44661871e89 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:53.617623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52aed47-1df8-4fcf-86bd-d44661871e89 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.618164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e52aed47-1df8-4fcf-86bd-d44661871e89 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:53.647406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e52aed47-1df8-4fcf-86bd-d44661871e89 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042065 Mar 08 13:25:53.648071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 589/1175] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:53.651227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ae38707f-c475-4a2c-ada3-cbb012651d8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:53.652314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ae38707f-c475-4a2c-ada3-cbb012651d8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:53.659323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae38707f-c475-4a2c-ada3-cbb012651d8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.659758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae38707f-c475-4a2c-ada3-cbb012651d8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:53.660530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae38707f-c475-4a2c-ada3-cbb012651d8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.660989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae38707f-c475-4a2c-ada3-cbb012651d8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:53.691124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ae38707f-c475-4a2c-ada3-cbb012651d8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Mar 08 13:25:53.691678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 587/1176] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:53.964608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:53.965572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:53.971300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.971803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:53.972566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.973107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:53.979210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:53.979858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:53.987871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.988581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:53.989766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:53.994487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:54.034321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:54.042477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9e4180f0-84ef-4d45-bc96-31e267dc65a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081928 Mar 08 13:25:54.043051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 590/1177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:53 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:54.133724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:54.142145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:54.143644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:54.144860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ad7fe227-1a0a-4280-83e6-be6fb4666aeb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.169605 Mar 08 13:25:54.145413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 588/1178] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:25:54.659345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2f512aab-5bef-4b08-abd4-0f6d2cdefd3e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:54.660172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2f512aab-5bef-4b08-abd4-0f6d2cdefd3e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:54.666586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f512aab-5bef-4b08-abd4-0f6d2cdefd3e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:54.667029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f512aab-5bef-4b08-abd4-0f6d2cdefd3e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:54.667781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f512aab-5bef-4b08-abd4-0f6d2cdefd3e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:54.668208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f512aab-5bef-4b08-abd4-0f6d2cdefd3e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:54.695929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2f512aab-5bef-4b08-abd4-0f6d2cdefd3e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040598 Mar 08 13:25:54.697216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 591/1179] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:54.702470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-27da38c1-c85c-41e5-af46-46ce7b1f6f17 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:54.703374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-27da38c1-c85c-41e5-af46-46ce7b1f6f17 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:54.709532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27da38c1-c85c-41e5-af46-46ce7b1f6f17 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:54.709977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27da38c1-c85c-41e5-af46-46ce7b1f6f17 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:54.710726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27da38c1-c85c-41e5-af46-46ce7b1f6f17 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:54.711151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-27da38c1-c85c-41e5-af46-46ce7b1f6f17 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:54.738038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-27da38c1-c85c-41e5-af46-46ce7b1f6f17 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039402 Mar 08 13:25:54.738566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 589/1180] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:55.059950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:55.060570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:55.066699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.067150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.067918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.068469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.127554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:55.135188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ef561b3b-1021-40ef-91e5-3959239ebf04 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079813 Mar 08 13:25:55.135773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 592/1181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:55.163092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:55.163695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:55.170106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.170553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.171394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.171833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.361923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:55.371377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:55.372898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:55.374043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c836a26b-ac9e-4c9e-bab0-f6c96ac6a013 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.214886 Mar 08 13:25:55.374599 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 590/1182] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:55.708877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cff14087-12a2-4e4e-ae08-456da646f039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:55.709793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cff14087-12a2-4e4e-ae08-456da646f039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:55.716122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff14087-12a2-4e4e-ae08-456da646f039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.716570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff14087-12a2-4e4e-ae08-456da646f039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.717368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff14087-12a2-4e4e-ae08-456da646f039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.717803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff14087-12a2-4e4e-ae08-456da646f039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.747450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cff14087-12a2-4e4e-ae08-456da646f039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042581 Mar 08 13:25:55.748181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 593/1183] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:55.750815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-76eae88f-c579-4613-91c9-ce31d812fe35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:55.751802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-76eae88f-c579-4613-91c9-ce31d812fe35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:55.757998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-76eae88f-c579-4613-91c9-ce31d812fe35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.758445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-76eae88f-c579-4613-91c9-ce31d812fe35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.759209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-76eae88f-c579-4613-91c9-ce31d812fe35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:55.759638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-76eae88f-c579-4613-91c9-ce31d812fe35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:55.787221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-76eae88f-c579-4613-91c9-ce31d812fe35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Mar 08 13:25:55.787780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 591/1184] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:56.151907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:56.152526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:56.158285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.158729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.159483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.159915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.220501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:56.227727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8f685039-b1f1-43f5-a0b9-896dd8294372 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079709 Mar 08 13:25:56.228385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 594/1185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:56 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:56.392462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:56.393086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:56.398984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.399425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.400178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.400611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.541606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:56.550169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:56.551696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:56.552879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-de9d31db-e671-449c-98de-a1e2f0140445 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.164258 Mar 08 13:25:56.553428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 592/1186] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:56.759181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b205470b-a21d-4aca-82d5-32044f80e815 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:56.760007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b205470b-a21d-4aca-82d5-32044f80e815 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:56.766228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b205470b-a21d-4aca-82d5-32044f80e815 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.766683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b205470b-a21d-4aca-82d5-32044f80e815 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.767444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b205470b-a21d-4aca-82d5-32044f80e815 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.767875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b205470b-a21d-4aca-82d5-32044f80e815 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.796006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b205470b-a21d-4aca-82d5-32044f80e815 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040835 Mar 08 13:25:56.796545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 595/1187] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:56.799150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-638c07e5-ae58-49c3-b9ff-cf7face4dc3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:56.800138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-638c07e5-ae58-49c3-b9ff-cf7face4dc3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:56.806639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-638c07e5-ae58-49c3-b9ff-cf7face4dc3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.807094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-638c07e5-ae58-49c3-b9ff-cf7face4dc3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.807863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-638c07e5-ae58-49c3-b9ff-cf7face4dc3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:56.808301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-638c07e5-ae58-49c3-b9ff-cf7face4dc3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:56.836064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-638c07e5-ae58-49c3-b9ff-cf7face4dc3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040871 Mar 08 13:25:56.837218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 593/1188] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:57.244963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:57.245565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:57.251609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.252050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.252837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.253269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.312485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:57.319914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e97c680f-3eb8-42a0-8ff4-032801c3f821 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079505 Mar 08 13:25:57.320463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 596/1189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:57.571914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:57.572440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:57.578394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.578849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.579607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.580042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.708595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:57.717242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:57.718762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:57.719881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f9c117e-9972-4ca4-83f2-f451824d6be7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152061 Mar 08 13:25:57.720434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 594/1190] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:57.807346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bafe4b35-b115-4b33-b88c-f0f61f36e3d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:57.808257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bafe4b35-b115-4b33-b88c-f0f61f36e3d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:57.814516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bafe4b35-b115-4b33-b88c-f0f61f36e3d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.814964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bafe4b35-b115-4b33-b88c-f0f61f36e3d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.815728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bafe4b35-b115-4b33-b88c-f0f61f36e3d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.816163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bafe4b35-b115-4b33-b88c-f0f61f36e3d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.844485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bafe4b35-b115-4b33-b88c-f0f61f36e3d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041058 Mar 08 13:25:57.844986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 597/1191] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:57.848069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f3e84e6f-2a6b-40a5-b859-a2e9a330724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:57.849073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f3e84e6f-2a6b-40a5-b859-a2e9a330724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:57.858831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e84e6f-2a6b-40a5-b859-a2e9a330724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.858831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e84e6f-2a6b-40a5-b859-a2e9a330724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.858831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e84e6f-2a6b-40a5-b859-a2e9a330724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:57.858831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e84e6f-2a6b-40a5-b859-a2e9a330724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:57.885320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f3e84e6f-2a6b-40a5-b859-a2e9a330724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Mar 08 13:25:57.885898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 595/1192] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:58.337202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:58.337742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:58.343858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.344440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.345247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.345687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.404415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:58.411606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bf50a6aa-1a43-4e92-b6f0-c610c4bba611 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078905 Mar 08 13:25:58.412159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 598/1193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:58.738683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:58.739314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:58.745298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.745741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.746492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.746921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.856367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2fc4822f-7da0-4c22-8400-ba35a8dea142 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:58.867820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2fc4822f-7da0-4c22-8400-ba35a8dea142 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:58.867820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc4822f-7da0-4c22-8400-ba35a8dea142 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.867820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc4822f-7da0-4c22-8400-ba35a8dea142 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.867820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc4822f-7da0-4c22-8400-ba35a8dea142 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.868854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc4822f-7da0-4c22-8400-ba35a8dea142 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.884503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:58.893388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:58.894901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:58.895186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2fc4822f-7da0-4c22-8400-ba35a8dea142 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Mar 08 13:25:58.895745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 599/1194] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:25:58.896056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c84022f1-adad-41dc-ac01-6b50d9de7fd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.161306 Mar 08 13:25:58.896793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 596/1195] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:25:58.902759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c8b144b1-cbec-47e3-af5e-91150d493b8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:58.903645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c8b144b1-cbec-47e3-af5e-91150d493b8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:58.909226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8b144b1-cbec-47e3-af5e-91150d493b8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.909682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8b144b1-cbec-47e3-af5e-91150d493b8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.910444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8b144b1-cbec-47e3-af5e-91150d493b8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:58.910877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8b144b1-cbec-47e3-af5e-91150d493b8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:58.939081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c8b144b1-cbec-47e3-af5e-91150d493b8a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Mar 08 13:25:58.939642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 600/1196] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:59.429079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:59.429684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:59.435528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.435972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.436744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.437175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.495322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:25:59.502762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cdcb7d8c-2495-45f0-ad12-dd0bc7bfd5d3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077527 Mar 08 13:25:59.503305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 597/1197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:25:59 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:25:59.906314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-73b6d89c-0179-4a55-ba01-81efee3094b5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:59.907209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-73b6d89c-0179-4a55-ba01-81efee3094b5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:59.913304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73b6d89c-0179-4a55-ba01-81efee3094b5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.913749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73b6d89c-0179-4a55-ba01-81efee3094b5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.913941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:59.914515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73b6d89c-0179-4a55-ba01-81efee3094b5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.914640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:59.914951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73b6d89c-0179-4a55-ba01-81efee3094b5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.921756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.922209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.922983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.923416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.943711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-73b6d89c-0179-4a55-ba01-81efee3094b5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041441 Mar 08 13:25:59.945673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 601/1198] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:25:59.951071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a42af4f8-fe32-4a1d-824f-74347fb17818 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:25:59.951955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a42af4f8-fe32-4a1d-824f-74347fb17818 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:25:59.957822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a42af4f8-fe32-4a1d-824f-74347fb17818 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.958556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a42af4f8-fe32-4a1d-824f-74347fb17818 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.959019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a42af4f8-fe32-4a1d-824f-74347fb17818 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:25:59.959452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a42af4f8-fe32-4a1d-824f-74347fb17818 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:25:59.987840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a42af4f8-fe32-4a1d-824f-74347fb17818 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040259 Mar 08 13:25:59.988393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 602/1199] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:25:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:00.057344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:00.065480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:00.066976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:00.068117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-111730d5-bb8d-4d1d-ab9d-b3f22aab00e0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158041 Mar 08 13:26:00.068680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 598/1200] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:25:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:00.519667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:00.520274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:00.526686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:00.527130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:00.527894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:00.528326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:00.586910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:00.594064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dc2e357b-3d06-4091-883f-c8553516b5ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078260 Mar 08 13:26:00.594606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 603/1201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:00 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:00.955563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dfe2065e-ea47-4960-b808-e9f4fef59618 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:00.956487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dfe2065e-ea47-4960-b808-e9f4fef59618 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:00.962948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfe2065e-ea47-4960-b808-e9f4fef59618 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:00.963391 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfe2065e-ea47-4960-b808-e9f4fef59618 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:00.964144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfe2065e-ea47-4960-b808-e9f4fef59618 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:00.964569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfe2065e-ea47-4960-b808-e9f4fef59618 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:00.991939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dfe2065e-ea47-4960-b808-e9f4fef59618 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040363 Mar 08 13:26:00.992466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 599/1202] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:01.000391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-19f1f45b-1b3c-4ded-a5e2-6e67915a32a7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:01.001325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-19f1f45b-1b3c-4ded-a5e2-6e67915a32a7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:01.007533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f1f45b-1b3c-4ded-a5e2-6e67915a32a7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:01.007978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f1f45b-1b3c-4ded-a5e2-6e67915a32a7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:01.008787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f1f45b-1b3c-4ded-a5e2-6e67915a32a7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:01.009306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f1f45b-1b3c-4ded-a5e2-6e67915a32a7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:01.036280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-19f1f45b-1b3c-4ded-a5e2-6e67915a32a7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040197 Mar 08 13:26:01.036850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 604/1203] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:01.086562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:01.087197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:01.092986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:01.093431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:01.094181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:01.094607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:01.222987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:01.231694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:01.233194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:01.234341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aa1fe5cd-c5b1-4ec6-a389-db623f650b0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151599 Mar 08 13:26:01.234887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 600/1204] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:01.610906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:01.611438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:01.617444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:01.618531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:01.619303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:01.619773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:01.680137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:01.688195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e292aadb-501a-40cb-8b89-d0d79b9d61a2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081301 Mar 08 13:26:01.688776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 605/1205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:02.004061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ca521677-3715-4ab2-8258-879cb73db5ec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:02.005005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ca521677-3715-4ab2-8258-879cb73db5ec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:02.011360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca521677-3715-4ab2-8258-879cb73db5ec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.011806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca521677-3715-4ab2-8258-879cb73db5ec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.012563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca521677-3715-4ab2-8258-879cb73db5ec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.013024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca521677-3715-4ab2-8258-879cb73db5ec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.041564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ca521677-3715-4ab2-8258-879cb73db5ec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Mar 08 13:26:02.042110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 601/1206] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:02.047469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-16b8c8f1-044d-4dec-9dbb-132f15014366 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:02.048372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-16b8c8f1-044d-4dec-9dbb-132f15014366 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:02.054498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16b8c8f1-044d-4dec-9dbb-132f15014366 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.054938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16b8c8f1-044d-4dec-9dbb-132f15014366 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.055746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16b8c8f1-044d-4dec-9dbb-132f15014366 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.056175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16b8c8f1-044d-4dec-9dbb-132f15014366 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.083084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-16b8c8f1-044d-4dec-9dbb-132f15014366 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039625 Mar 08 13:26:02.083606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 606/1207] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:02.252914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:02.253481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:02.259467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.259920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.260700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.261137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.392134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:02.400978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:02.402479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:02.403624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e6ddaed0-4b79-4746-b589-d80819237172 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154914 Mar 08 13:26:02.404175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 602/1208] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:02.704726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:02.705332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:02.710984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.711427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.712850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:02.713279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:02.775585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:02.783368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3c1980f1-b336-4a63-9198-e9e5d8bf82a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082580 Mar 08 13:26:02.783925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 607/1209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:03.053257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4f1616dc-0714-4d2f-91a8-53435beac460 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:03.054111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4f1616dc-0714-4d2f-91a8-53435beac460 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:03.060995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f1616dc-0714-4d2f-91a8-53435beac460 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.061480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f1616dc-0714-4d2f-91a8-53435beac460 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.062247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f1616dc-0714-4d2f-91a8-53435beac460 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.062730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f1616dc-0714-4d2f-91a8-53435beac460 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.090866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4f1616dc-0714-4d2f-91a8-53435beac460 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 Mar 08 13:26:03.091414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 603/1210] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:03.094959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-88b495aa-20e7-4483-ad10-06232b18fd8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:03.095875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-88b495aa-20e7-4483-ad10-06232b18fd8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:03.102148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b495aa-20e7-4483-ad10-06232b18fd8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.103098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b495aa-20e7-4483-ad10-06232b18fd8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.103865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b495aa-20e7-4483-ad10-06232b18fd8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.104315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b495aa-20e7-4483-ad10-06232b18fd8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.132757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-88b495aa-20e7-4483-ad10-06232b18fd8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Mar 08 13:26:03.133297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 608/1211] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:03.421990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:03.422604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:03.428904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.429359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.430125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.431780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.567214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:03.576177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:03.577736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:03.578876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-55298178-7569-4131-aac2-ca3e63169a0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160877 Mar 08 13:26:03.579427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 604/1212] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:03.799231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:03.799851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:03.806245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.806699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.807464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:03.807904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:03.865952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:03.874057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b1547696-89b8-4ef6-af43-81b72df00b86 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078649 Mar 08 13:26:03.874623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 609/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:03 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:04.102944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3d546260-e900-4c36-a4bb-fcf277070b59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:04.103769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3d546260-e900-4c36-a4bb-fcf277070b59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:04.109644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d546260-e900-4c36-a4bb-fcf277070b59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.110095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d546260-e900-4c36-a4bb-fcf277070b59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.110851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d546260-e900-4c36-a4bb-fcf277070b59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.111285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d546260-e900-4c36-a4bb-fcf277070b59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.139187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3d546260-e900-4c36-a4bb-fcf277070b59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040782 Mar 08 13:26:04.139725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 605/1214] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:04.143556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d8251d5b-8f72-4ad4-a60e-32f699fdfc36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:04.144491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d8251d5b-8f72-4ad4-a60e-32f699fdfc36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:04.150777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8251d5b-8f72-4ad4-a60e-32f699fdfc36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.151256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8251d5b-8f72-4ad4-a60e-32f699fdfc36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.152017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8251d5b-8f72-4ad4-a60e-32f699fdfc36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.152452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8251d5b-8f72-4ad4-a60e-32f699fdfc36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.180386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d8251d5b-8f72-4ad4-a60e-32f699fdfc36 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040899 Mar 08 13:26:04.181782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 610/1215] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:04.597214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:04.597853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:04.604058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.604506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.605306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.605742 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.734635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:04.742776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:04.744277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:04.745458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ef4c35eb-9b59-4ff7-9ef7-300b70b21ba6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152113 Mar 08 13:26:04.746009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 606/1216] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:04.891027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:04.891720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:04.898116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.898563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.900023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:04.900636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:04.958373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:04.966159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9c121bfd-22d5-4b76-885c-8028d131b21f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079115 Mar 08 13:26:04.966710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 611/1217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:05.149685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2323408b-673e-4868-8da4-42653cb2865a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:05.150512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2323408b-673e-4868-8da4-42653cb2865a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:05.156345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2323408b-673e-4868-8da4-42653cb2865a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.156820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2323408b-673e-4868-8da4-42653cb2865a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:05.157570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2323408b-673e-4868-8da4-42653cb2865a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.158003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2323408b-673e-4868-8da4-42653cb2865a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:05.186113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2323408b-673e-4868-8da4-42653cb2865a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040428 Mar 08 13:26:05.186980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 607/1218] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:05.192604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f0c94659-e1c2-4352-980a-98750379e90c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:05.193558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f0c94659-e1c2-4352-980a-98750379e90c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:05.200406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c94659-e1c2-4352-980a-98750379e90c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.200894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c94659-e1c2-4352-980a-98750379e90c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:05.201654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c94659-e1c2-4352-980a-98750379e90c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.202121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c94659-e1c2-4352-980a-98750379e90c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:05.230270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f0c94659-e1c2-4352-980a-98750379e90c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041585 Mar 08 13:26:05.230810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 612/1219] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:05.763433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:05.764049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:05.770278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.770724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:05.771478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.771917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:05.906923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:05.915678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:05.917206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:05.918351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-11df9748-4f07-4bc8-aa42-878e0c36c015 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158806 Mar 08 13:26:05.918896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 608/1220] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:05.984353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:05.984994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:05.991141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.991732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:05.992515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:05.993244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:06.051875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:06.059201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-154210ff-fbab-488a-bf9b-7e7510f607f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079687 Mar 08 13:26:06.059763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 613/1221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:06.198142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea0f16ba-bf37-43c8-9410-85d18280cc31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:06.199049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea0f16ba-bf37-43c8-9410-85d18280cc31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:06.204953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea0f16ba-bf37-43c8-9410-85d18280cc31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:06.205400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea0f16ba-bf37-43c8-9410-85d18280cc31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:06.206154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea0f16ba-bf37-43c8-9410-85d18280cc31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:06.206588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea0f16ba-bf37-43c8-9410-85d18280cc31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:06.234440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea0f16ba-bf37-43c8-9410-85d18280cc31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040909 Mar 08 13:26:06.234968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 609/1222] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:06.241639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5278be30-d558-4b56-b2b4-f6d1e210faf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:06.242552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5278be30-d558-4b56-b2b4-f6d1e210faf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:06.249066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5278be30-d558-4b56-b2b4-f6d1e210faf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:06.249524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5278be30-d558-4b56-b2b4-f6d1e210faf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:06.250547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5278be30-d558-4b56-b2b4-f6d1e210faf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:06.250985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5278be30-d558-4b56-b2b4-f6d1e210faf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:06.279752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5278be30-d558-4b56-b2b4-f6d1e210faf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041938 Mar 08 13:26:06.280296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 614/1223] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:06.936053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:06.936671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:06.943046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:06.943486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:06.944236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:06.944677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:07.076033 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:07.076650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:07.077606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:07.082594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:07.083051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:07.083830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:07.084271 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:07.085585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:07.087673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:07.088841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fc0003ce-b7ed-4264-9d35-489ccfd80453 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156682 Mar 08 13:26:07.089399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 610/1224] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:07.143469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:07.151730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-569cb506-9b38-4f14-a450-8a157d25c713 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080340 Mar 08 13:26:07.152282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 615/1225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:07 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:07.245882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4fa64a49-5d71-4bcc-93d0-646fff31135a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:07.246717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4fa64a49-5d71-4bcc-93d0-646fff31135a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:07.252989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa64a49-5d71-4bcc-93d0-646fff31135a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:07.253439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa64a49-5d71-4bcc-93d0-646fff31135a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:07.254196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa64a49-5d71-4bcc-93d0-646fff31135a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:07.254631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa64a49-5d71-4bcc-93d0-646fff31135a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:07.282851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4fa64a49-5d71-4bcc-93d0-646fff31135a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041588 Mar 08 13:26:07.283397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 611/1226] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:07.291474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e9c39b96-0fb4-4460-ad5a-fdbd51cd5024 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:07.292397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e9c39b96-0fb4-4460-ad5a-fdbd51cd5024 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:07.298725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9c39b96-0fb4-4460-ad5a-fdbd51cd5024 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:07.299171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9c39b96-0fb4-4460-ad5a-fdbd51cd5024 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:07.299928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9c39b96-0fb4-4460-ad5a-fdbd51cd5024 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:07.300352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9c39b96-0fb4-4460-ad5a-fdbd51cd5024 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:07.329562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e9c39b96-0fb4-4460-ad5a-fdbd51cd5024 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Mar 08 13:26:07.330482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 616/1227] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:08.108404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:08.109083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:08.117430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.117942 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.119306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.119753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.169141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:08.169757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:08.176128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.176563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.177368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.177800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.250724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:08.260107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-20e0e8be-6115-4e2e-a797-e066be5234ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.095436 Mar 08 13:26:08.261087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 617/1228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:08 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:08.280177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:08.288960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:08.290914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:08.293586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f4683358-6fb8-4897-89a6-abd9f4812cff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.189144 Mar 08 13:26:08.293952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 612/1229] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:08.297069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2846634e-542c-4e58-9d2c-a15961e87196 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:08.301965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2846634e-542c-4e58-9d2c-a15961e87196 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:08.305426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2846634e-542c-4e58-9d2c-a15961e87196 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.306133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2846634e-542c-4e58-9d2c-a15961e87196 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.307369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2846634e-542c-4e58-9d2c-a15961e87196 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.307817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2846634e-542c-4e58-9d2c-a15961e87196 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.338979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2846634e-542c-4e58-9d2c-a15961e87196 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048124 Mar 08 13:26:08.341353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 618/1230] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:08.344038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3e3b61ff-0c34-4a3a-8b55-c48ecd98e154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:08.344989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3e3b61ff-0c34-4a3a-8b55-c48ecd98e154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:08.351528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e3b61ff-0c34-4a3a-8b55-c48ecd98e154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.351971 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e3b61ff-0c34-4a3a-8b55-c48ecd98e154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.356035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e3b61ff-0c34-4a3a-8b55-c48ecd98e154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:08.356035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e3b61ff-0c34-4a3a-8b55-c48ecd98e154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:08.395755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3e3b61ff-0c34-4a3a-8b55-c48ecd98e154 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055409 Mar 08 13:26:08.396605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 613/1231] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:09.288244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:09.288871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:09.295418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.295862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.296625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.297083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.312378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:09.313022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:09.319208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.319664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.320432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.320898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.360606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:09.368892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0cc4e8b4-8cff-4c69-a325-66b449dc0138 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083770 Mar 08 13:26:09.369575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 619/1232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:09.374155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dfe6c976-a840-457b-bbb3-42d5372a7028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:09.375321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dfe6c976-a840-457b-bbb3-42d5372a7028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:09.381358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfe6c976-a840-457b-bbb3-42d5372a7028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.381808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfe6c976-a840-457b-bbb3-42d5372a7028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.382576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfe6c976-a840-457b-bbb3-42d5372a7028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.383010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfe6c976-a840-457b-bbb3-42d5372a7028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.411914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dfe6c976-a840-457b-bbb3-42d5372a7028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Mar 08 13:26:09.412482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 620/1233] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:09.417679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bc275dca-a4a9-4076-9055-76825b1af3d4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:09.418575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bc275dca-a4a9-4076-9055-76825b1af3d4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:09.424445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc275dca-a4a9-4076-9055-76825b1af3d4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.424931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc275dca-a4a9-4076-9055-76825b1af3d4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.425703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc275dca-a4a9-4076-9055-76825b1af3d4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:09.426146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc275dca-a4a9-4076-9055-76825b1af3d4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:09.454582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bc275dca-a4a9-4076-9055-76825b1af3d4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Mar 08 13:26:09.455142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 621/1234] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:09.459933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:09.468751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:09.470240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:09.471406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-45012c59-75ee-46c1-b6d3-2370c96c9976 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.162863 Mar 08 13:26:09.471946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 614/1235] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:10.386400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:10.387041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:10.393516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.394248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.395021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.395458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.423462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e31bfc44-e3c8-4eb0-af77-302b3c1b7fac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:10.424370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e31bfc44-e3c8-4eb0-af77-302b3c1b7fac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:10.430917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e31bfc44-e3c8-4eb0-af77-302b3c1b7fac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.431513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e31bfc44-e3c8-4eb0-af77-302b3c1b7fac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.432276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e31bfc44-e3c8-4eb0-af77-302b3c1b7fac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.432730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e31bfc44-e3c8-4eb0-af77-302b3c1b7fac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.454253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:10.462346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2493e582-54b5-416e-8cf4-33d74a818625 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079293 Mar 08 13:26:10.462919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 622/1236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:10.463149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e31bfc44-e3c8-4eb0-af77-302b3c1b7fac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 Mar 08 13:26:10.463679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 615/1237] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:10.467992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-64226e4a-19a7-421f-b0d5-7ec64eaf5600 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:10.468931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-64226e4a-19a7-421f-b0d5-7ec64eaf5600 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:10.474652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64226e4a-19a7-421f-b0d5-7ec64eaf5600 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.475109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64226e4a-19a7-421f-b0d5-7ec64eaf5600 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.475871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64226e4a-19a7-421f-b0d5-7ec64eaf5600 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.476310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64226e4a-19a7-421f-b0d5-7ec64eaf5600 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.489330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:10.489937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:10.495772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.496219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.497019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:10.497453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:10.505055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-64226e4a-19a7-421f-b0d5-7ec64eaf5600 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041098 Mar 08 13:26:10.505609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 623/1238] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:10.629646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:10.637948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:10.639439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:10.640573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-39c9665f-bbc1-494b-9641-bfffca7163cb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155039 Mar 08 13:26:10.641157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 616/1239] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:10 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:11.474713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2f23ea24-0a41-4582-83c2-9265367d3e6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:11.475649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2f23ea24-0a41-4582-83c2-9265367d3e6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:11.478521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:11.479191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:11.482231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f23ea24-0a41-4582-83c2-9265367d3e6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.482682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f23ea24-0a41-4582-83c2-9265367d3e6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.483446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f23ea24-0a41-4582-83c2-9265367d3e6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.483883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f23ea24-0a41-4582-83c2-9265367d3e6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.485314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.485756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.486511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.486938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.512540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2f23ea24-0a41-4582-83c2-9265367d3e6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041818 Mar 08 13:26:11.513129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 624/1240] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:11.517566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-35a5ec03-889c-408a-a993-2f7ff0abc907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:11.518439 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-35a5ec03-889c-408a-a993-2f7ff0abc907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:11.524040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35a5ec03-889c-408a-a993-2f7ff0abc907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.525272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35a5ec03-889c-408a-a993-2f7ff0abc907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.526035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35a5ec03-889c-408a-a993-2f7ff0abc907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.526470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35a5ec03-889c-408a-a993-2f7ff0abc907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.550342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:11.555249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-35a5ec03-889c-408a-a993-2f7ff0abc907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041113 Mar 08 13:26:11.556351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 625/1241] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:11.557719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-78c67430-ace0-4ace-ac45-d8d4a6f70720 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083033 Mar 08 13:26:11.558269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 617/1242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:11 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:11.658574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:11.659116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:11.665415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.665875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.666678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:11.667122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:11.801129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:11.809703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:11.811177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:11.812318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77ed7cca-4085-4cd5-972e-76aad237b240 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157574 Mar 08 13:26:11.812902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 626/1243] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:12.523356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5ad03dba-d31a-405c-9ccc-7f04720d4a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:12.524842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5ad03dba-d31a-405c-9ccc-7f04720d4a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:12.531055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ad03dba-d31a-405c-9ccc-7f04720d4a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.531499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ad03dba-d31a-405c-9ccc-7f04720d4a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.532253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ad03dba-d31a-405c-9ccc-7f04720d4a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.532704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ad03dba-d31a-405c-9ccc-7f04720d4a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.562240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5ad03dba-d31a-405c-9ccc-7f04720d4a08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 Mar 08 13:26:12.562791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 618/1244] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:12.567323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-29becbe9-fc01-4fb6-b21a-1ad78de8d0c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:12.568224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-29becbe9-fc01-4fb6-b21a-1ad78de8d0c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:12.573736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:12.574377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:12.574818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29becbe9-fc01-4fb6-b21a-1ad78de8d0c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.575263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29becbe9-fc01-4fb6-b21a-1ad78de8d0c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.576022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29becbe9-fc01-4fb6-b21a-1ad78de8d0c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.576456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-29becbe9-fc01-4fb6-b21a-1ad78de8d0c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.580043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.580490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.581340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.581773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.605281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-29becbe9-fc01-4fb6-b21a-1ad78de8d0c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041815 Mar 08 13:26:12.605756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 627/1245] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:12.640550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:12.647819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b5854c2d-abc2-4f0d-a362-9a1d305c5be8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077716 Mar 08 13:26:12.648367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 619/1246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:12.830977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:12.831571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:12.838100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.838568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.839303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:12.839734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:12.972784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:12.981254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:12.982761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:12.983928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-04412e48-34f5-40ec-8c02-82c6948a53d7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156847 Mar 08 13:26:12.984483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 628/1247] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:13.573547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-12684d72-bfbc-452a-b54a-0d662433f86d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:13.574450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-12684d72-bfbc-452a-b54a-0d662433f86d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:13.580680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12684d72-bfbc-452a-b54a-0d662433f86d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:13.581153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12684d72-bfbc-452a-b54a-0d662433f86d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:13.581915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12684d72-bfbc-452a-b54a-0d662433f86d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:13.582351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12684d72-bfbc-452a-b54a-0d662433f86d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:13.611040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-12684d72-bfbc-452a-b54a-0d662433f86d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042126 Mar 08 13:26:13.611518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 620/1248] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:13.616617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cfbb1bfc-55ae-4fa1-8dd7-2111adb03e3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:13.617538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cfbb1bfc-55ae-4fa1-8dd7-2111adb03e3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:13.624516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfbb1bfc-55ae-4fa1-8dd7-2111adb03e3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:13.624988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfbb1bfc-55ae-4fa1-8dd7-2111adb03e3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:13.626024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfbb1bfc-55ae-4fa1-8dd7-2111adb03e3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:13.626454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfbb1bfc-55ae-4fa1-8dd7-2111adb03e3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:13.653782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cfbb1bfc-55ae-4fa1-8dd7-2111adb03e3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 Mar 08 13:26:13.654503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 629/1249] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:13.665953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:13.666609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:13.678177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:13.678630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:13.679411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:13.679851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:13.745179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:13.752793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e13ba7b2-8d48-4707-bd28-bee666f9cf42 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.091908 Mar 08 13:26:13.753352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 621/1250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:14.003163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:14.003768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:14.010166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.010616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.011396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.011832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.143712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:14.151627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:14.153156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:14.154305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-967c445a-3060-44dd-a710-83d456aaef86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155598 Mar 08 13:26:14.154854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 630/1251] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:14.622709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-82163350-d809-4f80-87e3-1ca1c558cee7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:14.623539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-82163350-d809-4f80-87e3-1ca1c558cee7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:14.630116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82163350-d809-4f80-87e3-1ca1c558cee7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.630560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82163350-d809-4f80-87e3-1ca1c558cee7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.631326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82163350-d809-4f80-87e3-1ca1c558cee7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.631758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-82163350-d809-4f80-87e3-1ca1c558cee7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.660390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-82163350-d809-4f80-87e3-1ca1c558cee7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041694 Mar 08 13:26:14.660974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 622/1252] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:14.666364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0012dcad-a767-4581-9cdd-efe2c41cda8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:14.667287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0012dcad-a767-4581-9cdd-efe2c41cda8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:14.673463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0012dcad-a767-4581-9cdd-efe2c41cda8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.673902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0012dcad-a767-4581-9cdd-efe2c41cda8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.674665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0012dcad-a767-4581-9cdd-efe2c41cda8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.675094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0012dcad-a767-4581-9cdd-efe2c41cda8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.703623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0012dcad-a767-4581-9cdd-efe2c41cda8f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042358 Mar 08 13:26:14.704169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 631/1253] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:14.768607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:14.769243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:14.775532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.775982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.776774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:14.777211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:14.835178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:14.842479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4dc1f24b-0484-43e1-af3f-536233abeff6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077679 Mar 08 13:26:14.843049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 623/1254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:14 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:15.173078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:15.173682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:15.179435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.179885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.181290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.181731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.307578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:15.316381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:15.317896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:15.319056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0c34c01d-81e1-4c63-aaf7-fa0d3b2d6ab5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.149879 Mar 08 13:26:15.319605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 632/1255] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:15.671534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f658ea2b-56be-4bbb-86a1-c59c694eb40d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:15.672445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f658ea2b-56be-4bbb-86a1-c59c694eb40d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:15.678660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f658ea2b-56be-4bbb-86a1-c59c694eb40d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.679105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f658ea2b-56be-4bbb-86a1-c59c694eb40d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.679856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f658ea2b-56be-4bbb-86a1-c59c694eb40d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.680329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f658ea2b-56be-4bbb-86a1-c59c694eb40d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.708271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f658ea2b-56be-4bbb-86a1-c59c694eb40d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040655 Mar 08 13:26:15.708822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 624/1256] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:15.715672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a036ef35-974e-4644-bc96-7a6e8ddf103e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:15.716577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a036ef35-974e-4644-bc96-7a6e8ddf103e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:15.722732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a036ef35-974e-4644-bc96-7a6e8ddf103e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.723181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a036ef35-974e-4644-bc96-7a6e8ddf103e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.723939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a036ef35-974e-4644-bc96-7a6e8ddf103e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.724373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a036ef35-974e-4644-bc96-7a6e8ddf103e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.752316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a036ef35-974e-4644-bc96-7a6e8ddf103e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041291 Mar 08 13:26:15.752887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 633/1257] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:15.858900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:15.859509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:15.865487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.865926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.866688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:15.867121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:15.926148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:15.933415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ae3474ce-62d0-4abc-bfd9-03cf2585c328 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078318 Mar 08 13:26:15.933975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 625/1258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:15 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:16.337982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:16.338589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:16.344536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.345020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:16.345790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.346225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:16.479876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:16.487883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:16.489416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:16.490573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-713aa373-6890-4f5a-b2e6-60aa7d46f913 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157086 Mar 08 13:26:16.491125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 634/1259] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:16.720408 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7e93069a-ba8c-410c-9222-0f891b217814 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:16.721369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7e93069a-ba8c-410c-9222-0f891b217814 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:16.727677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e93069a-ba8c-410c-9222-0f891b217814 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.728154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e93069a-ba8c-410c-9222-0f891b217814 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:16.728937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e93069a-ba8c-410c-9222-0f891b217814 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.729369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e93069a-ba8c-410c-9222-0f891b217814 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:16.758018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7e93069a-ba8c-410c-9222-0f891b217814 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040677 Mar 08 13:26:16.758018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 626/1260] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:16.763980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0e6c94a6-6084-4bbf-ac5c-b52d8e841dbf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:16.764933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0e6c94a6-6084-4bbf-ac5c-b52d8e841dbf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:16.771198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a6-6084-4bbf-ac5c-b52d8e841dbf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.771643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a6-6084-4bbf-ac5c-b52d8e841dbf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:16.772408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a6-6084-4bbf-ac5c-b52d8e841dbf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.772880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0e6c94a6-6084-4bbf-ac5c-b52d8e841dbf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:16.800954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0e6c94a6-6084-4bbf-ac5c-b52d8e841dbf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040760 Mar 08 13:26:16.801503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 635/1261] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:16.950610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:16.951265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:16.957055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.957500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:16.958255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:16.958688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:17.021106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:17.028523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f406170f-4344-4d1d-a311-9cc33feba378 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082502 Mar 08 13:26:17.029158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 627/1262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:17.508938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:17.509570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:17.515413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:17.515862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:17.516631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:17.517112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:17.646911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:17.654969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:17.656440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:17.657606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1e5c0d83-afbe-47ec-b03e-ea34660abc3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152760 Mar 08 13:26:17.658151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 636/1263] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:17.769155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-38c6a773-43a0-4b13-967f-7b80d90a8e4a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:17.770125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-38c6a773-43a0-4b13-967f-7b80d90a8e4a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:17.776965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38c6a773-43a0-4b13-967f-7b80d90a8e4a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:17.782256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38c6a773-43a0-4b13-967f-7b80d90a8e4a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:17.782256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38c6a773-43a0-4b13-967f-7b80d90a8e4a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:17.782256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38c6a773-43a0-4b13-967f-7b80d90a8e4a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:17.807099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-38c6a773-43a0-4b13-967f-7b80d90a8e4a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Mar 08 13:26:17.807638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 628/1264] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:17.811512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3d4c6ac4-7d71-4e65-b3fe-ec242f84b5ca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:17.812415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3d4c6ac4-7d71-4e65-b3fe-ec242f84b5ca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:17.818356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d4c6ac4-7d71-4e65-b3fe-ec242f84b5ca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:17.818801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d4c6ac4-7d71-4e65-b3fe-ec242f84b5ca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:17.819553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d4c6ac4-7d71-4e65-b3fe-ec242f84b5ca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:17.819985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d4c6ac4-7d71-4e65-b3fe-ec242f84b5ca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:17.847467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3d4c6ac4-7d71-4e65-b3fe-ec242f84b5ca tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039761 Mar 08 13:26:17.848002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 637/1265] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:18.045716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:18.046318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:18.052036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.052477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.053262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.053693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.114698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:18.122091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e07c4282-9be4-4946-b756-e852bf78000b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080326 Mar 08 13:26:18.122648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 629/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:18.676573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:18.677219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:18.684169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.684624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.685422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.685868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.816797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:18.818806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6c70cb6a-f7f3-40a6-b565-2f94bac5a868 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:18.819721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6c70cb6a-f7f3-40a6-b565-2f94bac5a868 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:18.826266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:18.826546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c70cb6a-f7f3-40a6-b565-2f94bac5a868 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.827034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c70cb6a-f7f3-40a6-b565-2f94bac5a868 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.827799 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:18.827925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c70cb6a-f7f3-40a6-b565-2f94bac5a868 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.828229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c70cb6a-f7f3-40a6-b565-2f94bac5a868 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.828988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e659cc1d-257f-404d-854e-d123b63f81e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156504 Mar 08 13:26:18.829536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 638/1267] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:18.856961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6c70cb6a-f7f3-40a6-b565-2f94bac5a868 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042156 Mar 08 13:26:18.863702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 630/1268] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:18.863833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5068f1bf-0534-4d55-889a-8f7c27da4787 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:18.863833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5068f1bf-0534-4d55-889a-8f7c27da4787 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:18.866529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5068f1bf-0534-4d55-889a-8f7c27da4787 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.866981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5068f1bf-0534-4d55-889a-8f7c27da4787 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.867878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5068f1bf-0534-4d55-889a-8f7c27da4787 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:18.868839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5068f1bf-0534-4d55-889a-8f7c27da4787 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:18.897120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5068f1bf-0534-4d55-889a-8f7c27da4787 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041530 Mar 08 13:26:18.897702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 639/1269] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:19.139076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:19.139689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:19.145518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.145965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.146721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.147157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.205433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:19.213457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0f5d9cbb-b82c-4d27-99cf-33470a9ea830 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078156 Mar 08 13:26:19.214044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 631/1270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:19.847183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:19.847772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:19.854148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.859223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.859223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.859223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.872384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8234e82a-51ba-422a-ba77-c7bc9e19c698 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:19.873374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8234e82a-51ba-422a-ba77-c7bc9e19c698 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:19.879866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8234e82a-51ba-422a-ba77-c7bc9e19c698 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.880315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8234e82a-51ba-422a-ba77-c7bc9e19c698 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.881113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8234e82a-51ba-422a-ba77-c7bc9e19c698 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.881548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8234e82a-51ba-422a-ba77-c7bc9e19c698 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.911531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8234e82a-51ba-422a-ba77-c7bc9e19c698 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Mar 08 13:26:19.912080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 632/1271] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:19.916849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2ae741c5-ea79-4d8f-affa-77c4b37cba52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:19.917744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2ae741c5-ea79-4d8f-affa-77c4b37cba52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:19.923421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ae741c5-ea79-4d8f-affa-77c4b37cba52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.923868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ae741c5-ea79-4d8f-affa-77c4b37cba52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.924633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ae741c5-ea79-4d8f-affa-77c4b37cba52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:19.925099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ae741c5-ea79-4d8f-affa-77c4b37cba52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:19.954314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2ae741c5-ea79-4d8f-affa-77c4b37cba52 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041205 Mar 08 13:26:19.955057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 633/1272] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:19.988894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:19.997981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:19.999616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:20.001052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-04ce7138-738e-458f-a4df-614eb1830c44 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157776 Mar 08 13:26:20.001620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 640/1273] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:20.230493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:20.231101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:20.236952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:20.237406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:20.238166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:20.238600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:20.296472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:20.303702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-884c290f-0334-4c8d-86a0-bce72263fe5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077478 Mar 08 13:26:20.304251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 634/1274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:20 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:20.923235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a3b138a-6dc1-4ea4-b5c2-59e8973d9ab4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:20.924477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a3b138a-6dc1-4ea4-b5c2-59e8973d9ab4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:20.930870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3b138a-6dc1-4ea4-b5c2-59e8973d9ab4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:20.931428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3b138a-6dc1-4ea4-b5c2-59e8973d9ab4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:20.932185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3b138a-6dc1-4ea4-b5c2-59e8973d9ab4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:20.932619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3b138a-6dc1-4ea4-b5c2-59e8973d9ab4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:20.960937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a3b138a-6dc1-4ea4-b5c2-59e8973d9ab4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Mar 08 13:26:20.961998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 641/1275] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:20.966465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7f5df69d-5c64-4fa6-ab97-346026793fdf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:20.967371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7f5df69d-5c64-4fa6-ab97-346026793fdf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:20.973614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f5df69d-5c64-4fa6-ab97-346026793fdf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:20.974061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f5df69d-5c64-4fa6-ab97-346026793fdf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:20.974818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f5df69d-5c64-4fa6-ab97-346026793fdf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:20.975253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f5df69d-5c64-4fa6-ab97-346026793fdf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:21.004440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7f5df69d-5c64-4fa6-ab97-346026793fdf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042436 Mar 08 13:26:21.005028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 635/1276] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:21.019050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:21.019649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:21.026591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:21.027040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:21.027800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:21.028234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:21.156126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:21.164172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:21.165792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:21.166945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e76215e5-0a41-46f5-ad27-99e32090d31a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151720 Mar 08 13:26:21.167493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 642/1277] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:21.321486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:21.322233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:21.328093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:21.328543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:21.329332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:21.329768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:21.388177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:21.395399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-96b940d1-0e7b-4986-aa93-3363e9e8a59f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078312 Mar 08 13:26:21.395946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 636/1278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:21.973438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e9ff1c8e-4810-47cb-ab83-fef015348e98 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:21.974362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e9ff1c8e-4810-47cb-ab83-fef015348e98 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:21.981399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9ff1c8e-4810-47cb-ab83-fef015348e98 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:21.981854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9ff1c8e-4810-47cb-ab83-fef015348e98 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:21.982628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9ff1c8e-4810-47cb-ab83-fef015348e98 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:21.983067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9ff1c8e-4810-47cb-ab83-fef015348e98 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:22.013150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e9ff1c8e-4810-47cb-ab83-fef015348e98 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Mar 08 13:26:22.013710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 643/1279] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:22.015808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf3767de-a3f9-46c3-b8b4-a3c0f6e68ae0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:22.016754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf3767de-a3f9-46c3-b8b4-a3c0f6e68ae0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:22.022977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf3767de-a3f9-46c3-b8b4-a3c0f6e68ae0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:22.023430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf3767de-a3f9-46c3-b8b4-a3c0f6e68ae0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:22.024819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf3767de-a3f9-46c3-b8b4-a3c0f6e68ae0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:22.025261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf3767de-a3f9-46c3-b8b4-a3c0f6e68ae0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:22.053542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf3767de-a3f9-46c3-b8b4-a3c0f6e68ae0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041713 Mar 08 13:26:22.054087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 637/1280] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:22.185526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:22.186130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:22.192571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:22.193050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:22.193810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:22.194262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:22.327042 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:22.335339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:22.337237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:22.338391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a688a3ce-9e93-41b6-a3e0-7291c5b9212a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156763 Mar 08 13:26:22.338939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 644/1281] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:22.412466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:22.413113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:22.419298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:22.419751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:22.420516 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:22.421074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:22.479811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:22.487184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-099ad653-7d95-4a79-b008-64f3ed5f2e99 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078582 Mar 08 13:26:22.487738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 638/1282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:22 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:23.025521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bd0d774e-2911-4502-9576-2a403bb567b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:23.026579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bd0d774e-2911-4502-9576-2a403bb567b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:23.033101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0d774e-2911-4502-9576-2a403bb567b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.033557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0d774e-2911-4502-9576-2a403bb567b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.034321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0d774e-2911-4502-9576-2a403bb567b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.034757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0d774e-2911-4502-9576-2a403bb567b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.063001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bd0d774e-2911-4502-9576-2a403bb567b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042255 Mar 08 13:26:23.063547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 645/1283] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:23.065132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b359ffff-1273-4216-83bf-9c891ca0abbd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:23.066049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b359ffff-1273-4216-83bf-9c891ca0abbd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:23.072224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b359ffff-1273-4216-83bf-9c891ca0abbd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.072692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b359ffff-1273-4216-83bf-9c891ca0abbd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.073463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b359ffff-1273-4216-83bf-9c891ca0abbd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.073895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b359ffff-1273-4216-83bf-9c891ca0abbd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.101763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b359ffff-1273-4216-83bf-9c891ca0abbd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040761 Mar 08 13:26:23.103057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 639/1284] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:23.360629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:23.361256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:23.367067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.367514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.368347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.368720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.499470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:23.504965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:23.505677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:23.508104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:23.510364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:23.511525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-35fa618b-d942-43b9-aadc-f9dfa74fc049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154796 Mar 08 13:26:23.512080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 646/1285] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:23.512720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.513181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.514027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:23.514465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:23.573873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:23.581156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4cb395aa-acfc-43d3-9540-4dab2cf4d385 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080086 Mar 08 13:26:23.581710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 640/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:23 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:24.077112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a43644ef-fe8b-40d7-b317-8571727a1c4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:24.079004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a43644ef-fe8b-40d7-b317-8571727a1c4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:24.086798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a43644ef-fe8b-40d7-b317-8571727a1c4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.087262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a43644ef-fe8b-40d7-b317-8571727a1c4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.088149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a43644ef-fe8b-40d7-b317-8571727a1c4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.088629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a43644ef-fe8b-40d7-b317-8571727a1c4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.113147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5577c833-af0c-4c8a-a9d4-02cb85f3f526 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:24.114048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5577c833-af0c-4c8a-a9d4-02cb85f3f526 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:24.120325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a43644ef-fe8b-40d7-b317-8571727a1c4f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049736 Mar 08 13:26:24.120906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5577c833-af0c-4c8a-a9d4-02cb85f3f526 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.121084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 647/1287] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:24.121350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5577c833-af0c-4c8a-a9d4-02cb85f3f526 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.122260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5577c833-af0c-4c8a-a9d4-02cb85f3f526 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.122691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5577c833-af0c-4c8a-a9d4-02cb85f3f526 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.150369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5577c833-af0c-4c8a-a9d4-02cb85f3f526 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041026 Mar 08 13:26:24.150899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 641/1288] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:24.530852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:24.531464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:24.537443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.537894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.538657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.539099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.598486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:24.599138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:24.605763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.606213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.606978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:24.607434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:24.669573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:24.674566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:24.676818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a8b7605-c529-4043-87dc-4adab0b08e6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082399 Mar 08 13:26:24.677376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 642/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:24.683618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:24.685381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:24.687140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c11c7742-e85d-416d-a590-3193cb5e017b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160043 Mar 08 13:26:24.687948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 648/1290] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:25.131824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9390e175-7984-4384-9bbd-bf4a94fd606f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:25.132786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9390e175-7984-4384-9bbd-bf4a94fd606f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:25.139050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9390e175-7984-4384-9bbd-bf4a94fd606f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.139498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9390e175-7984-4384-9bbd-bf4a94fd606f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.140275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9390e175-7984-4384-9bbd-bf4a94fd606f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.140722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9390e175-7984-4384-9bbd-bf4a94fd606f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.161396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dce327ab-3159-4147-8333-f543ece79951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:25.162304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dce327ab-3159-4147-8333-f543ece79951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:25.169152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9390e175-7984-4384-9bbd-bf4a94fd606f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041190 Mar 08 13:26:25.169323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dce327ab-3159-4147-8333-f543ece79951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.169613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dce327ab-3159-4147-8333-f543ece79951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.169720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 643/1291] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:25.170529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dce327ab-3159-4147-8333-f543ece79951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.171040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dce327ab-3159-4147-8333-f543ece79951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.200460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dce327ab-3159-4147-8333-f543ece79951 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042930 Mar 08 13:26:25.201027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 649/1292] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:25.693676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:25.694276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:25.700124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.700568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.701358 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.701790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.706551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:25.707159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:25.713539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.713999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.714765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:25.715690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:25.764418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:25.771725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f5a86768-719c-4d7a-b871-3c90c3c5b7b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081893 Mar 08 13:26:25.772318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 644/1293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:25.847441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:25.856780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:25.858317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:25.859463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4e7b714-5eb2-476e-a076-cbb9a2f29041 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156826 Mar 08 13:26:25.860039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 650/1294] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:26.179993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1a71735e-2dcc-461b-bc2d-fe2b1a195526 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:26.181186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1a71735e-2dcc-461b-bc2d-fe2b1a195526 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:26.187457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a71735e-2dcc-461b-bc2d-fe2b1a195526 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.187905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a71735e-2dcc-461b-bc2d-fe2b1a195526 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:26.188685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a71735e-2dcc-461b-bc2d-fe2b1a195526 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.189122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a71735e-2dcc-461b-bc2d-fe2b1a195526 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:26.211979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a1377634-c649-4241-bb24-9f3d37986143 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:26.213001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a1377634-c649-4241-bb24-9f3d37986143 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:26.217405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1a71735e-2dcc-461b-bc2d-fe2b1a195526 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041342 Mar 08 13:26:26.217964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 645/1295] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:26.219189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1377634-c649-4241-bb24-9f3d37986143 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.219644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1377634-c649-4241-bb24-9f3d37986143 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:26.220416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1377634-c649-4241-bb24-9f3d37986143 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.220883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1377634-c649-4241-bb24-9f3d37986143 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:26.249029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a1377634-c649-4241-bb24-9f3d37986143 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Mar 08 13:26:26.249484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 651/1296] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:26.787510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:26.788117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:26.794022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.794470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:26.795233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.795666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:26.854349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:26.861501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3ac52987-b22d-4dcc-84e6-6915e825517c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077825 Mar 08 13:26:26.862067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 646/1297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:26.877753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:26.878359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:26.884795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.885245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:26.886073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:26.886516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:27.019600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:27.028184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:27.029809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:27.030965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ade94a3a-851b-413c-8bef-9b34406a8419 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157365 Mar 08 13:26:27.031545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 652/1298] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:27.229795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f199a49b-3ed8-4c45-9007-99f7b3de8780 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:27.230712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f199a49b-3ed8-4c45-9007-99f7b3de8780 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:27.237029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f199a49b-3ed8-4c45-9007-99f7b3de8780 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:27.237486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f199a49b-3ed8-4c45-9007-99f7b3de8780 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:27.238255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f199a49b-3ed8-4c45-9007-99f7b3de8780 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:27.238692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f199a49b-3ed8-4c45-9007-99f7b3de8780 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:27.260805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fa3679e0-608f-4e8f-a00f-1f055ea17a8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:27.261713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fa3679e0-608f-4e8f-a00f-1f055ea17a8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:27.267455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f199a49b-3ed8-4c45-9007-99f7b3de8780 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042502 Mar 08 13:26:27.267809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa3679e0-608f-4e8f-a00f-1f055ea17a8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:27.268013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 647/1299] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:27.268257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa3679e0-608f-4e8f-a00f-1f055ea17a8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:27.269118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa3679e0-608f-4e8f-a00f-1f055ea17a8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:27.269552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa3679e0-608f-4e8f-a00f-1f055ea17a8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:27.297795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fa3679e0-608f-4e8f-a00f-1f055ea17a8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 Mar 08 13:26:27.298325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 653/1300] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:27.879705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:27.880312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:27.886706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:27.889972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:27.889972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:27.889972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:27.945718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:27.953629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0f31a444-f67a-49cd-be98-cd1dc931c630 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078039 Mar 08 13:26:27.954176 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 648/1301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:27 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:28.049198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:28.049811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:28.055933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.056394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:28.057200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.057643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:28.185877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:28.194014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:28.195507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:28.197435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f5bbdd05-21c8-40a4-8290-ce476f56243e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152132 Mar 08 13:26:28.197992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 654/1302] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:28.279130 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-464cde0a-05b4-4c48-b604-6c480e8542a3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:28.280065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-464cde0a-05b4-4c48-b604-6c480e8542a3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:28.286311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-464cde0a-05b4-4c48-b604-6c480e8542a3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.286822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-464cde0a-05b4-4c48-b604-6c480e8542a3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:28.287573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-464cde0a-05b4-4c48-b604-6c480e8542a3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.287999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-464cde0a-05b4-4c48-b604-6c480e8542a3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:28.309130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e50a7cd3-9179-40ef-9ad0-153b34182556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:28.310031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e50a7cd3-9179-40ef-9ad0-153b34182556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:28.316205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e50a7cd3-9179-40ef-9ad0-153b34182556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.316665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e50a7cd3-9179-40ef-9ad0-153b34182556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:28.316783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-464cde0a-05b4-4c48-b604-6c480e8542a3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041648 Mar 08 13:26:28.317467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 649/1303] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:28.317600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e50a7cd3-9179-40ef-9ad0-153b34182556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.317878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e50a7cd3-9179-40ef-9ad0-153b34182556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:28.350478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e50a7cd3-9179-40ef-9ad0-153b34182556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Mar 08 13:26:28.351045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 655/1304] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:28.971498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:28.972105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:28.978870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.979315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:28.980075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:28.980508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:29.062485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:29.069879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-be262b70-7784-4723-ac88-f68e1ed2b62d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.102279 Mar 08 13:26:29.070438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 650/1305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:29.215808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:29.216405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:29.222341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:29.222731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:29.223478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:29.223910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:29.331524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8e7e365-8104-4f90-8419-3631cfda6500 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:29.332987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d8e7e365-8104-4f90-8419-3631cfda6500 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:29.343671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8e7e365-8104-4f90-8419-3631cfda6500 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:29.344124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8e7e365-8104-4f90-8419-3631cfda6500 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:29.345402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8e7e365-8104-4f90-8419-3631cfda6500 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:29.345402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8e7e365-8104-4f90-8419-3631cfda6500 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:29.357953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:29.367689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:29.370424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:29.371616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e27ece3d-2b24-4c55-bf9f-2cf77da1e25f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160221 Mar 08 13:26:29.372168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 656/1306] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:29.376971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1cacf488-e433-4f6d-8d44-119114ec67c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:29.377856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1cacf488-e433-4f6d-8d44-119114ec67c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:29.379314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d8e7e365-8104-4f90-8419-3631cfda6500 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053762 Mar 08 13:26:29.380251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 651/1307] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:29.383552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cacf488-e433-4f6d-8d44-119114ec67c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:29.383998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cacf488-e433-4f6d-8d44-119114ec67c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:29.385353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cacf488-e433-4f6d-8d44-119114ec67c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:29.385895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cacf488-e433-4f6d-8d44-119114ec67c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:29.414661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1cacf488-e433-4f6d-8d44-119114ec67c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Mar 08 13:26:29.415203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 657/1308] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:30.085818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:30.086424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:30.092330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.092800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.093584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.094013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.152965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:30.160252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ae97ed5b-71b1-4d82-a5ec-17596711f7be tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078293 Mar 08 13:26:30.160842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 652/1309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:30.389710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:30.390316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:30.392186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1261d8b3-432f-4e9a-8921-15f3b558c08f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:30.393142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1261d8b3-432f-4e9a-8921-15f3b558c08f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:30.396587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.397061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.397827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.398261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.399239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1261d8b3-432f-4e9a-8921-15f3b558c08f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.399687 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1261d8b3-432f-4e9a-8921-15f3b558c08f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.400449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1261d8b3-432f-4e9a-8921-15f3b558c08f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.400913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1261d8b3-432f-4e9a-8921-15f3b558c08f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.429009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1261d8b3-432f-4e9a-8921-15f3b558c08f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040751 Mar 08 13:26:30.429564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 653/1310] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:30.434790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-004e4a16-d183-4677-b772-0f9c6f748a9e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:30.435690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-004e4a16-d183-4677-b772-0f9c6f748a9e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:30.441410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-004e4a16-d183-4677-b772-0f9c6f748a9e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.441855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-004e4a16-d183-4677-b772-0f9c6f748a9e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.442621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-004e4a16-d183-4677-b772-0f9c6f748a9e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:30.443051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-004e4a16-d183-4677-b772-0f9c6f748a9e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:30.471276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-004e4a16-d183-4677-b772-0f9c6f748a9e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040700 Mar 08 13:26:30.471831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 654/1311] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:30.534090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:30.542861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:30.544333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:30.545505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9b0ad755-c6c3-433e-9312-b099b9bcbcab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159695 Mar 08 13:26:30.546051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 658/1312] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:31.177310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:31.177920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:31.184500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.184972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.185732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.186166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.247327 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:31.254950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-739aa1e5-510f-4150-ba61-cac33922f173 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081485 Mar 08 13:26:31.255498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 655/1313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:31 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:31.441105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cb7ff1cd-93e0-43ec-90fe-06cd8763af15 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:31.441950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cb7ff1cd-93e0-43ec-90fe-06cd8763af15 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:31.448320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb7ff1cd-93e0-43ec-90fe-06cd8763af15 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.448797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb7ff1cd-93e0-43ec-90fe-06cd8763af15 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.449563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb7ff1cd-93e0-43ec-90fe-06cd8763af15 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.450007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb7ff1cd-93e0-43ec-90fe-06cd8763af15 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.477839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cb7ff1cd-93e0-43ec-90fe-06cd8763af15 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040712 Mar 08 13:26:31.479170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 659/1314] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:31.483715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0228084b-9676-496e-ad0a-e9436051b940 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:31.484630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0228084b-9676-496e-ad0a-e9436051b940 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:31.490910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0228084b-9676-496e-ad0a-e9436051b940 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.491362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0228084b-9676-496e-ad0a-e9436051b940 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.492125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0228084b-9676-496e-ad0a-e9436051b940 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.492563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0228084b-9676-496e-ad0a-e9436051b940 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.521117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0228084b-9676-496e-ad0a-e9436051b940 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042433 Mar 08 13:26:31.521658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 656/1315] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:31.563500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:31.564105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:31.569954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.570407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.571167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:31.571602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:31.701235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:31.709326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:31.710825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:31.711980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b18fc374-d671-4049-a26f-ffab69141b3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152342 Mar 08 13:26:31.712530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 660/1316] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:32.271372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:32.271984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:32.278877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.279331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.280118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.280552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.339880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:32.347307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c9207d0d-fc4e-4657-a01f-cdb336be4e51 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079884 Mar 08 13:26:32.347873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 657/1317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:32 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:32.490245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee09b5aa-b5b5-42ed-a8be-a1301f2e4fae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:32.491075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee09b5aa-b5b5-42ed-a8be-a1301f2e4fae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:32.497317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee09b5aa-b5b5-42ed-a8be-a1301f2e4fae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.497765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee09b5aa-b5b5-42ed-a8be-a1301f2e4fae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.498527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee09b5aa-b5b5-42ed-a8be-a1301f2e4fae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.498961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee09b5aa-b5b5-42ed-a8be-a1301f2e4fae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.527621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee09b5aa-b5b5-42ed-a8be-a1301f2e4fae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 Mar 08 13:26:32.528052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 661/1318] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:32.532633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8ba72a54-366a-42b1-b5ff-4f6a3ceed363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:32.533560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8ba72a54-366a-42b1-b5ff-4f6a3ceed363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:32.539355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ba72a54-366a-42b1-b5ff-4f6a3ceed363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.539802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ba72a54-366a-42b1-b5ff-4f6a3ceed363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.540551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ba72a54-366a-42b1-b5ff-4f6a3ceed363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.541139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ba72a54-366a-42b1-b5ff-4f6a3ceed363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.568201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8ba72a54-366a-42b1-b5ff-4f6a3ceed363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039490 Mar 08 13:26:32.568753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 658/1319] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:32.729887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:32.730556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:32.736496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.736982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.737750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:32.738248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:32.870476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:32.878869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:32.880357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:32.881529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aa66bcee-c670-4785-8cbc-2a03ae137b38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155855 Mar 08 13:26:32.882085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 662/1320] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:32 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:33.364100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:33.364750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:33.371132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.371582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:33.372344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.372828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:33.433341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:33.440557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3284bd01-9466-4193-a4b8-eeb9238a3342 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080305 Mar 08 13:26:33.441143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 659/1321] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:33 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:33.538157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ab866425-cc97-4f18-a123-6714e52bf6b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:33.539068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ab866425-cc97-4f18-a123-6714e52bf6b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:33.545301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab866425-cc97-4f18-a123-6714e52bf6b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.545753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab866425-cc97-4f18-a123-6714e52bf6b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:33.546514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab866425-cc97-4f18-a123-6714e52bf6b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.546947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab866425-cc97-4f18-a123-6714e52bf6b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:33.575202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ab866425-cc97-4f18-a123-6714e52bf6b7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 Mar 08 13:26:33.575746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 663/1322] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:33.579808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bbe0f3bf-2634-4675-bc38-7a8b7200645d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:33.580745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bbe0f3bf-2634-4675-bc38-7a8b7200645d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:33.586507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe0f3bf-2634-4675-bc38-7a8b7200645d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.586946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe0f3bf-2634-4675-bc38-7a8b7200645d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:33.587697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe0f3bf-2634-4675-bc38-7a8b7200645d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.588155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe0f3bf-2634-4675-bc38-7a8b7200645d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:33.616521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bbe0f3bf-2634-4675-bc38-7a8b7200645d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 Mar 08 13:26:33.617021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 660/1323] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:33.899330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:33.899886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:33.906080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.906525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:33.907277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:33.907707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:34.037067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:34.045864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:34.047367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:34.048524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4f43e06d-1233-4eb2-b88d-da699f43226b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153164 Mar 08 13:26:34.049106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 664/1324] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:34.457001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:34.457608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:34.464329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:34.464798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:34.465552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:34.465980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:34.523951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:34.531677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dd0eb753-6e1d-460c-b7ca-0424fec7276f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078499 Mar 08 13:26:34.532224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 661/1325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:34 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:34.586589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-28cd8582-5661-4f00-bce9-6495e66489ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:34.587498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-28cd8582-5661-4f00-bce9-6495e66489ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:34.594573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cd8582-5661-4f00-bce9-6495e66489ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:34.595025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cd8582-5661-4f00-bce9-6495e66489ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:34.595827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cd8582-5661-4f00-bce9-6495e66489ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:34.596265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cd8582-5661-4f00-bce9-6495e66489ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:34.624061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-28cd8582-5661-4f00-bce9-6495e66489ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041288 Mar 08 13:26:34.624723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 665/1326] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:34.628620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-83c8e392-7a09-4f52-ba65-e15384351cde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:34.629585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-83c8e392-7a09-4f52-ba65-e15384351cde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:34.636342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83c8e392-7a09-4f52-ba65-e15384351cde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:34.637163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83c8e392-7a09-4f52-ba65-e15384351cde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:34.637952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83c8e392-7a09-4f52-ba65-e15384351cde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:34.638389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83c8e392-7a09-4f52-ba65-e15384351cde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:34.666957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-83c8e392-7a09-4f52-ba65-e15384351cde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042516 Mar 08 13:26:34.667504 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 662/1327] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:35.067367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:35.067972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:35.074697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.076996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.076996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.076996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.205490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:35.213871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:35.215358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:35.216505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9c2b1348-18d2-406b-9d36-b2dc31087ec8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153160 Mar 08 13:26:35.217091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 666/1328] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:35.548255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:35.548890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:35.555102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.555548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.556307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.557344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.614649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:35.622770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b693d77e-55eb-4b6b-b4d0-c64663872623 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078348 Mar 08 13:26:35.623337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 663/1329] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:35 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:35.635437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a8311dc-e07c-4ace-84f7-a866d43d148b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:35.636412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a8311dc-e07c-4ace-84f7-a866d43d148b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:35.642638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a8311dc-e07c-4ace-84f7-a866d43d148b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.643088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a8311dc-e07c-4ace-84f7-a866d43d148b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.643849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a8311dc-e07c-4ace-84f7-a866d43d148b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.644287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a8311dc-e07c-4ace-84f7-a866d43d148b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.672000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a8311dc-e07c-4ace-84f7-a866d43d148b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040626 Mar 08 13:26:35.672543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 667/1330] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:35.678209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-34bea55f-5241-4591-81b8-403221b40362 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:35.679137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-34bea55f-5241-4591-81b8-403221b40362 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:35.685565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bea55f-5241-4591-81b8-403221b40362 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.686012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bea55f-5241-4591-81b8-403221b40362 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.686761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bea55f-5241-4591-81b8-403221b40362 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:35.687190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34bea55f-5241-4591-81b8-403221b40362 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:35.714401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-34bea55f-5241-4591-81b8-403221b40362 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040069 Mar 08 13:26:35.714932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 664/1331] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:36.235069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:36.235627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:36.241565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.242023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.242785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.243222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.376103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:36.384293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:36.386720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:36.387877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3503fe98-a148-4f14-b036-970848ea8c08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156791 Mar 08 13:26:36.388425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 668/1332] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:36.640200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:36.640771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:36.647027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.647479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.648246 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.648698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.685042 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-917c69e2-e435-47b4-afa5-d003cb919c1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:36.686192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-917c69e2-e435-47b4-afa5-d003cb919c1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:36.692831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-917c69e2-e435-47b4-afa5-d003cb919c1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.693362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-917c69e2-e435-47b4-afa5-d003cb919c1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.694225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-917c69e2-e435-47b4-afa5-d003cb919c1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.694727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-917c69e2-e435-47b4-afa5-d003cb919c1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.711672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:36.720794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4325a473-2a8e-436b-b6f8-029bb9df7526 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083016 Mar 08 13:26:36.721360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 665/1333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:36 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:36.725901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d9b7a9e2-5072-494f-89ab-ea25010cb23f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:36.726796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d9b7a9e2-5072-494f-89ab-ea25010cb23f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:36.731730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-917c69e2-e435-47b4-afa5-d003cb919c1d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052170 Mar 08 13:26:36.732291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 669/1334] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:36.733368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9b7a9e2-5072-494f-89ab-ea25010cb23f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.733846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9b7a9e2-5072-494f-89ab-ea25010cb23f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.734623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9b7a9e2-5072-494f-89ab-ea25010cb23f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:36.735056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9b7a9e2-5072-494f-89ab-ea25010cb23f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:36.763915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d9b7a9e2-5072-494f-89ab-ea25010cb23f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Mar 08 13:26:36.764450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 666/1335] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:37.406742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:37.407351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:37.413297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.413750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.414520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.414960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.543794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:37.551850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:37.553402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:37.554566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0499f983-6dac-4bac-a2d6-09927f34623d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151755 Mar 08 13:26:37.555114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 670/1336] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:37 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:37.737523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:37.738265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:37.742749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-821aea64-d29f-4710-9533-ab933703fe07 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:37.743677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-821aea64-d29f-4710-9533-ab933703fe07 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:37.745542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.745999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.746776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.747213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.752173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-821aea64-d29f-4710-9533-ab933703fe07 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.752621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-821aea64-d29f-4710-9533-ab933703fe07 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.753433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-821aea64-d29f-4710-9533-ab933703fe07 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.753870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-821aea64-d29f-4710-9533-ab933703fe07 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.783015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-821aea64-d29f-4710-9533-ab933703fe07 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Mar 08 13:26:37.783565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 671/1337] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:37.788019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fb6d599d-c9d6-47d5-8fe8-817d501e5d1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:37.788934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fb6d599d-c9d6-47d5-8fe8-817d501e5d1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:37.795424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb6d599d-c9d6-47d5-8fe8-817d501e5d1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.795875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb6d599d-c9d6-47d5-8fe8-817d501e5d1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.796651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb6d599d-c9d6-47d5-8fe8-817d501e5d1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:37.797114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb6d599d-c9d6-47d5-8fe8-817d501e5d1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:37.819467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:37.826434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fb6d599d-c9d6-47d5-8fe8-817d501e5d1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041849 Mar 08 13:26:37.826995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 672/1338] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:37.827111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-465f802d-663b-46d5-9bd8-483e5c630ce7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.093381 Mar 08 13:26:37.827689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 667/1339] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:37 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:38.571960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:38.573107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:38.579031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.579481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.580243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.580821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.714985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:38.723100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:38.724597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:38.725792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f5ac84a6-2b7c-4057-b938-1053227d7e38 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157719 Mar 08 13:26:38.726352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 673/1340] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:38 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:38.794274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bd97f7da-d161-4411-a30c-53edf500713b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:38.795176 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bd97f7da-d161-4411-a30c-53edf500713b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:38.801651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd97f7da-d161-4411-a30c-53edf500713b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.802095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd97f7da-d161-4411-a30c-53edf500713b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.802850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd97f7da-d161-4411-a30c-53edf500713b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.803278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd97f7da-d161-4411-a30c-53edf500713b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.831348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bd97f7da-d161-4411-a30c-53edf500713b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040982 Mar 08 13:26:38.831883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 668/1341] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:38.837508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a7d7c141-6d11-464c-8339-9234ae95c23c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:38.838442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a7d7c141-6d11-464c-8339-9234ae95c23c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:38.842912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:38.843521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:38.844686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7d7c141-6d11-464c-8339-9234ae95c23c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.845135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7d7c141-6d11-464c-8339-9234ae95c23c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.845899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7d7c141-6d11-464c-8339-9234ae95c23c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.846334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7d7c141-6d11-464c-8339-9234ae95c23c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.849154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.849609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.850369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:38.850806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:38.876014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a7d7c141-6d11-464c-8339-9234ae95c23c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042079 Mar 08 13:26:38.876573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 674/1342] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:38.909592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:38.917268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a9049b3-9e03-466f-940a-8e6cbb03e7cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078017 Mar 08 13:26:38.917763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 669/1343] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:38 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:39.743176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:39.743779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:39.749726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.750166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:39.751177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.751610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:39.843896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-170ea8f9-6bd0-4a7a-b952-0a81a2a53b79 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:39.844846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-170ea8f9-6bd0-4a7a-b952-0a81a2a53b79 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:39.851257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-170ea8f9-6bd0-4a7a-b952-0a81a2a53b79 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.851711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-170ea8f9-6bd0-4a7a-b952-0a81a2a53b79 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:39.852500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-170ea8f9-6bd0-4a7a-b952-0a81a2a53b79 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.852974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-170ea8f9-6bd0-4a7a-b952-0a81a2a53b79 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:39.885366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-170ea8f9-6bd0-4a7a-b952-0a81a2a53b79 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Mar 08 13:26:39.886003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 670/1344] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:39.888309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:39.890534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9c5f1081-389f-4257-a135-8f2e8a236235 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:39.891426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9c5f1081-389f-4257-a135-8f2e8a236235 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:39.897016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c5f1081-389f-4257-a135-8f2e8a236235 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.897367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:39.897496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c5f1081-389f-4257-a135-8f2e8a236235 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:39.898190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c5f1081-389f-4257-a135-8f2e8a236235 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.898624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c5f1081-389f-4257-a135-8f2e8a236235 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:39.898992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:39.900865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-55318ce2-b3e9-4a81-b6a6-e653d51738bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160936 Mar 08 13:26:39.901652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 675/1345] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:39.926616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9c5f1081-389f-4257-a135-8f2e8a236235 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039620 Mar 08 13:26:39.927145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 671/1346] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:39.934139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:39.934756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:39.940523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.941009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:39.941802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:39.942239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:40.003530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:40.011473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1e18f824-6828-4c45-b147-863324783ade tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081233 Mar 08 13:26:40.012031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 676/1347] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:39 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:40.897105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-02c1c2da-8e9b-44e8-9895-11c53e6e46d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:40.898008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-02c1c2da-8e9b-44e8-9895-11c53e6e46d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:40.904445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02c1c2da-8e9b-44e8-9895-11c53e6e46d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:40.904931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02c1c2da-8e9b-44e8-9895-11c53e6e46d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:40.905686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02c1c2da-8e9b-44e8-9895-11c53e6e46d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:40.906115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02c1c2da-8e9b-44e8-9895-11c53e6e46d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:40.919899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:40.920511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:40.926713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:40.927160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:40.927926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:40.928370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:40.934877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-02c1c2da-8e9b-44e8-9895-11c53e6e46d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 Mar 08 13:26:40.935586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 672/1348] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:40.939865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e1ee96bb-5e24-46e7-a2fa-7162d387c5ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:40.940774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e1ee96bb-5e24-46e7-a2fa-7162d387c5ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:40.946300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1ee96bb-5e24-46e7-a2fa-7162d387c5ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:40.946742 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1ee96bb-5e24-46e7-a2fa-7162d387c5ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:40.947525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1ee96bb-5e24-46e7-a2fa-7162d387c5ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:40.948059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1ee96bb-5e24-46e7-a2fa-7162d387c5ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:40.975964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e1ee96bb-5e24-46e7-a2fa-7162d387c5ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039526 Mar 08 13:26:40.976520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 673/1349] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:41.027811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:41.028505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:41.034178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:41.034620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:41.035375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:41.035806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:41.065904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:41.074451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:41.075949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:41.077212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0823c59-8de7-4fd8-a472-8645d233b1f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.161673 Mar 08 13:26:41.077770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 677/1350] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:41.095667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:41.103040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a67680b8-5e12-4650-a59f-202eeada52a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079751 Mar 08 13:26:41.104270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 674/1351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:41.946519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d4329d06-6488-4194-9f4a-b0eabdf62517 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:41.948061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d4329d06-6488-4194-9f4a-b0eabdf62517 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:41.954302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4329d06-6488-4194-9f4a-b0eabdf62517 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:41.954753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4329d06-6488-4194-9f4a-b0eabdf62517 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:41.955515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4329d06-6488-4194-9f4a-b0eabdf62517 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:41.955955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4329d06-6488-4194-9f4a-b0eabdf62517 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:41.983864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d4329d06-6488-4194-9f4a-b0eabdf62517 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041312 Mar 08 13:26:41.984429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 678/1352] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:41.987497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-621b2a8b-56b7-4b98-9387-1f4ab03740c3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:41.988405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-621b2a8b-56b7-4b98-9387-1f4ab03740c3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:41.995280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-621b2a8b-56b7-4b98-9387-1f4ab03740c3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:41.995765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-621b2a8b-56b7-4b98-9387-1f4ab03740c3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:41.996562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-621b2a8b-56b7-4b98-9387-1f4ab03740c3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:41.997064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-621b2a8b-56b7-4b98-9387-1f4ab03740c3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:42.025209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-621b2a8b-56b7-4b98-9387-1f4ab03740c3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Mar 08 13:26:42.025801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 675/1353] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:42.096727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:42.097340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:42.103220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:42.104180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:42.105132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:42.105571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:42.119604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:42.120250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:42.126399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:42.126958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:42.127719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:42.128191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:42.188333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:42.195709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5e30cf67-67f4-4f98-a876-68702bdcc364 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080508 Mar 08 13:26:42.196262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 676/1354] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:42.235229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:42.243493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:42.246224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:42.247543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cd13a835-c27b-403d-88f8-47d99016e9fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154726 Mar 08 13:26:42.248114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 679/1355] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:42.994905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-68d14172-b815-42d3-ba2a-e5f1030ab786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:42.995818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-68d14172-b815-42d3-ba2a-e5f1030ab786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:43.002821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68d14172-b815-42d3-ba2a-e5f1030ab786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.003475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68d14172-b815-42d3-ba2a-e5f1030ab786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.004292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68d14172-b815-42d3-ba2a-e5f1030ab786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.004746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68d14172-b815-42d3-ba2a-e5f1030ab786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.033285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-68d14172-b815-42d3-ba2a-e5f1030ab786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Mar 08 13:26:43.033828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 677/1356] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:43.036772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-56461556-01ed-4618-a682-6419d13b63a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:43.037682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-56461556-01ed-4618-a682-6419d13b63a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:43.044170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56461556-01ed-4618-a682-6419d13b63a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.044622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56461556-01ed-4618-a682-6419d13b63a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.045409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56461556-01ed-4618-a682-6419d13b63a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.045841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56461556-01ed-4618-a682-6419d13b63a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.074750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-56461556-01ed-4618-a682-6419d13b63a6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 Mar 08 13:26:43.075293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 680/1357] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:43.212354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:43.213015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:43.218821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.219271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.220032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.220467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.266899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:43.267429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:43.273246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.273701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.274470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:43.274919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:43.279157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:43.286424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-de64a01f-537a-4a23-9f49-1efc55b7a277 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077856 Mar 08 13:26:43.286989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 678/1358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:43 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:43.408464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:43.416875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:43.418373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:43.419527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-158d3097-b4a6-4ea5-9e76-03f54c31c990 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156647 Mar 08 13:26:43.420105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 681/1359] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:44.045029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2fbcb9a6-a25a-4b48-a45a-793061b8e641 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:44.045940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2fbcb9a6-a25a-4b48-a45a-793061b8e641 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:44.052202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fbcb9a6-a25a-4b48-a45a-793061b8e641 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.052676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fbcb9a6-a25a-4b48-a45a-793061b8e641 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.053503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fbcb9a6-a25a-4b48-a45a-793061b8e641 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.053935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fbcb9a6-a25a-4b48-a45a-793061b8e641 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.084961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2fbcb9a6-a25a-4b48-a45a-793061b8e641 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Mar 08 13:26:44.085784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 679/1360] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:44.086182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5b1c3dd0-7d2c-445e-b53c-eb40191ade08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:44.087325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5b1c3dd0-7d2c-445e-b53c-eb40191ade08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:44.094549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b1c3dd0-7d2c-445e-b53c-eb40191ade08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.095007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b1c3dd0-7d2c-445e-b53c-eb40191ade08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.095784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b1c3dd0-7d2c-445e-b53c-eb40191ade08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.096224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b1c3dd0-7d2c-445e-b53c-eb40191ade08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.130516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5b1c3dd0-7d2c-445e-b53c-eb40191ade08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048229 Mar 08 13:26:44.131088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 682/1361] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:44.302287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:44.302812 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:44.308959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.309410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.310174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.310622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.369815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:44.377369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3d780ab2-e23e-43c1-97c6-2cb6f0152381 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079039 Mar 08 13:26:44.377926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 680/1362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:44 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:44.437767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:44.438430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:44.444762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.445222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.445997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:44.446440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:44.581290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:44.590206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:44.591705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:44.592976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f3aac559-da5e-4516-8824-b4636e20878a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159125 Mar 08 13:26:44.593600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 683/1363] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:45.100281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4bb1078c-9337-4876-8c3e-9bfd10ce4a85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:45.101233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4bb1078c-9337-4876-8c3e-9bfd10ce4a85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:45.110546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bb1078c-9337-4876-8c3e-9bfd10ce4a85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.110992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bb1078c-9337-4876-8c3e-9bfd10ce4a85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.111838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bb1078c-9337-4876-8c3e-9bfd10ce4a85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.112279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bb1078c-9337-4876-8c3e-9bfd10ce4a85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.143206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-033b3b54-829e-42ca-8a94-bbfd53153e53 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:45.144116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-033b3b54-829e-42ca-8a94-bbfd53153e53 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:45.149871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-033b3b54-829e-42ca-8a94-bbfd53153e53 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.150339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-033b3b54-829e-42ca-8a94-bbfd53153e53 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.150717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4bb1078c-9337-4876-8c3e-9bfd10ce4a85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056583 Mar 08 13:26:45.151230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-033b3b54-829e-42ca-8a94-bbfd53153e53 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.151666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-033b3b54-829e-42ca-8a94-bbfd53153e53 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.151852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 681/1364] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:45.181645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-033b3b54-829e-42ca-8a94-bbfd53153e53 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 Mar 08 13:26:45.183055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 684/1365] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:45.395855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:45.396409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:45.402959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.403399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.404148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.404582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.470620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:45.478019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bfb08455-3507-4933-a865-dcc25d2936c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087151 Mar 08 13:26:45.478566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 682/1366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:45 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:45.610753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:45.611361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:45.617304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.617763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.618532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:45.618969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:45.751031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:45.761236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:45.763004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:45.764232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2234168b-4d8e-422d-b86e-c5eecaeb0f52 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157430 Mar 08 13:26:45.764813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 685/1367] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:46.163197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-70fd19b0-f515-4d38-8757-ac2570a26d8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:46.164110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-70fd19b0-f515-4d38-8757-ac2570a26d8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:46.171283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70fd19b0-f515-4d38-8757-ac2570a26d8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.171732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70fd19b0-f515-4d38-8757-ac2570a26d8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.172493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70fd19b0-f515-4d38-8757-ac2570a26d8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.172960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70fd19b0-f515-4d38-8757-ac2570a26d8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.193858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-279fa3b1-d554-4f9f-ac64-568a4ca1629b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:46.194757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-279fa3b1-d554-4f9f-ac64-568a4ca1629b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:46.200961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279fa3b1-d554-4f9f-ac64-568a4ca1629b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.201415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279fa3b1-d554-4f9f-ac64-568a4ca1629b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.201866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-70fd19b0-f515-4d38-8757-ac2570a26d8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042761 Mar 08 13:26:46.202172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279fa3b1-d554-4f9f-ac64-568a4ca1629b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.202421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 683/1368] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:46.202605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-279fa3b1-d554-4f9f-ac64-568a4ca1629b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.231067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-279fa3b1-d554-4f9f-ac64-568a4ca1629b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041097 Mar 08 13:26:46.231811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 686/1369] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:46.497378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:46.497974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:46.504017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.504458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.505248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.505677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.566143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:46.574333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a53d5672-8ec4-44ad-bbbc-7230741c9aec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080743 Mar 08 13:26:46.575203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 684/1370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:46.784072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:46.785039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:46.791260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.791738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.792497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:46.792955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:46.926791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:46.935808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:46.937336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:46.938557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e46fc072-a99e-4fa9-b66d-55821b7b504e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159408 Mar 08 13:26:46.939116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 687/1371] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:47.212846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-66c9b305-c42a-45f8-9975-dd1979924dbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:47.214338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-66c9b305-c42a-45f8-9975-dd1979924dbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:47.220537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66c9b305-c42a-45f8-9975-dd1979924dbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.221010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66c9b305-c42a-45f8-9975-dd1979924dbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:47.221760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66c9b305-c42a-45f8-9975-dd1979924dbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.222353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66c9b305-c42a-45f8-9975-dd1979924dbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:47.241716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a0e0f2e3-2cf7-4b49-85e1-f0718461ece0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:47.242618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a0e0f2e3-2cf7-4b49-85e1-f0718461ece0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:47.248890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0e0f2e3-2cf7-4b49-85e1-f0718461ece0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.249335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0e0f2e3-2cf7-4b49-85e1-f0718461ece0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:47.250101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0e0f2e3-2cf7-4b49-85e1-f0718461ece0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.250804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0e0f2e3-2cf7-4b49-85e1-f0718461ece0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:47.253016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-66c9b305-c42a-45f8-9975-dd1979924dbd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Mar 08 13:26:47.253562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 685/1372] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:47.279362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a0e0f2e3-2cf7-4b49-85e1-f0718461ece0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Mar 08 13:26:47.279897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 688/1373] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:47.591987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:47.592590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:47.598462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.598900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:47.599651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.600077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:47.658392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:47.665572 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d2cace3b-5f6f-4def-acbb-35908e146448 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078233 Mar 08 13:26:47.666125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 686/1374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:47.956407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:47.957038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:47.963046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.963652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:47.964408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:47.964879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:48.092673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:48.101016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:48.102610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:48.104414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e29ea677-a1c2-4073-b619-11883f99680a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.151344 Mar 08 13:26:48.105053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 689/1375] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:48.264130 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a7b9493f-09c7-4044-8ec6-15bc7817a4c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:48.265049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a7b9493f-09c7-4044-8ec6-15bc7817a4c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:48.271549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b9493f-09c7-4044-8ec6-15bc7817a4c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:48.272034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b9493f-09c7-4044-8ec6-15bc7817a4c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:48.272851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b9493f-09c7-4044-8ec6-15bc7817a4c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:48.273288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b9493f-09c7-4044-8ec6-15bc7817a4c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:48.290685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1c46ba34-c89e-4123-a4c3-34a6b8f3811d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:48.292147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1c46ba34-c89e-4123-a4c3-34a6b8f3811d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:48.298577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c46ba34-c89e-4123-a4c3-34a6b8f3811d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:48.299029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c46ba34-c89e-4123-a4c3-34a6b8f3811d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:48.299804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c46ba34-c89e-4123-a4c3-34a6b8f3811d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:48.300241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c46ba34-c89e-4123-a4c3-34a6b8f3811d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:48.302564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a7b9493f-09c7-4044-8ec6-15bc7817a4c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Mar 08 13:26:48.303168 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 687/1376] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:48.329598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1c46ba34-c89e-4123-a4c3-34a6b8f3811d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042890 Mar 08 13:26:48.330149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 690/1377] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:48.682281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:48.682908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:48.688735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:48.689181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:48.689933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:48.690364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:48.751883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:48.759249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-943e506e-6638-4d41-be4e-015b9dcb8a71 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080963 Mar 08 13:26:48.759798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 688/1378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:48 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:49.122776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:49.123387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:49.129548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.129995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.130758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.131195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.268566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:49.279596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:49.281106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:49.282247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ae769907-cef6-4010-be22-c1ed31f95851 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163776 Mar 08 13:26:49.282804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 691/1379] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:49.314162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf761805-7edb-4c20-9aa4-d103c32c3d0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:49.315101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf761805-7edb-4c20-9aa4-d103c32c3d0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:49.321483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf761805-7edb-4c20-9aa4-d103c32c3d0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.321934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf761805-7edb-4c20-9aa4-d103c32c3d0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.322723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf761805-7edb-4c20-9aa4-d103c32c3d0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.323486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf761805-7edb-4c20-9aa4-d103c32c3d0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.341847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4509520b-8054-44a7-91e6-f68074fb7f19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:49.342756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4509520b-8054-44a7-91e6-f68074fb7f19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:49.349003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4509520b-8054-44a7-91e6-f68074fb7f19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.349454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4509520b-8054-44a7-91e6-f68074fb7f19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.350294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4509520b-8054-44a7-91e6-f68074fb7f19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.350666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4509520b-8054-44a7-91e6-f68074fb7f19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.353061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf761805-7edb-4c20-9aa4-d103c32c3d0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042708 Mar 08 13:26:49.353627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 689/1380] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:49.379943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4509520b-8054-44a7-91e6-f68074fb7f19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042787 Mar 08 13:26:49.380483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 692/1381] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:49.777163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:49.777769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:49.783566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.784011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.784800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:49.785228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:49.845077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:49.853362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5a8da257-ccc1-4e41-9da8-41629582fdca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081060 Mar 08 13:26:49.857519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 690/1382] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:49 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:50.300937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:50.301623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:50.308347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.308817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.309578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.310010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.365688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1c628850-e8e6-4363-971b-6e43621e8c5e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:50.366672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1c628850-e8e6-4363-971b-6e43621e8c5e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:50.374161 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1c628850-e8e6-4363-971b-6e43621e8c5e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.374615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1c628850-e8e6-4363-971b-6e43621e8c5e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.375754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1c628850-e8e6-4363-971b-6e43621e8c5e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.376202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1c628850-e8e6-4363-971b-6e43621e8c5e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.405377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1c628850-e8e6-4363-971b-6e43621e8c5e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Mar 08 13:26:50.406373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 691/1383] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:50.412521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b521c7d6-318a-4808-97e2-10b443f78fef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:50.413571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b521c7d6-318a-4808-97e2-10b443f78fef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:50.422465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b521c7d6-318a-4808-97e2-10b443f78fef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.422909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b521c7d6-318a-4808-97e2-10b443f78fef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.423786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b521c7d6-318a-4808-97e2-10b443f78fef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.424223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b521c7d6-318a-4808-97e2-10b443f78fef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.445343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:50.454416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:50.455903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:50.457110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b8abadf8-bab0-4f95-861d-dce1cf043942 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.160149 Mar 08 13:26:50.460699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b521c7d6-318a-4808-97e2-10b443f78fef tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053140 Mar 08 13:26:50.461964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 692/1384] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:50.464981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 693/1385] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:50.871730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:50.872445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:50.878699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.882866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.882866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:50.882866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:50.946112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:50.955526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-55249a0c-afb1-4229-ba72-4710f924e6d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.088699 Mar 08 13:26:50.956251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 693/1386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:51.418232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5c82537c-047a-4208-a967-088699782021 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:51.419170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5c82537c-047a-4208-a967-088699782021 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:51.425486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c82537c-047a-4208-a967-088699782021 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.425941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c82537c-047a-4208-a967-088699782021 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:51.426711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c82537c-047a-4208-a967-088699782021 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.427149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5c82537c-047a-4208-a967-088699782021 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:51.455396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5c82537c-047a-4208-a967-088699782021 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041885 Mar 08 13:26:51.456086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 694/1387] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:51.472135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fdedd984-38af-4aa1-b021-a1f9bbef872e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:51.473068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fdedd984-38af-4aa1-b021-a1f9bbef872e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:51.474573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:51.475183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:51.480339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdedd984-38af-4aa1-b021-a1f9bbef872e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.480829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdedd984-38af-4aa1-b021-a1f9bbef872e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:51.481638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdedd984-38af-4aa1-b021-a1f9bbef872e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.481774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.482110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdedd984-38af-4aa1-b021-a1f9bbef872e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:51.482222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:51.482971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.483449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:51.511735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fdedd984-38af-4aa1-b021-a1f9bbef872e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Mar 08 13:26:51.512302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 694/1388] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:51.615480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:51.623825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:51.625628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:51.626793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-023766d7-1bdc-4b82-9742-e0d346b23a90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155839 Mar 08 13:26:51.627349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 695/1389] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:51.971352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:51.971962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:51.978102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.978550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:51.979949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:51.979949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:52.042308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:52.049769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-589d5701-3070-42df-9dcf-0402b08fb9d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082272 Mar 08 13:26:52.050330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 695/1390] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:52.467473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7766115c-09bd-46fc-8a22-956eb567f367 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:52.468387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7766115c-09bd-46fc-8a22-956eb567f367 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:52.474666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7766115c-09bd-46fc-8a22-956eb567f367 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:52.475128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7766115c-09bd-46fc-8a22-956eb567f367 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:52.475880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7766115c-09bd-46fc-8a22-956eb567f367 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:52.476315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7766115c-09bd-46fc-8a22-956eb567f367 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:52.505305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7766115c-09bd-46fc-8a22-956eb567f367 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042152 Mar 08 13:26:52.505851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 696/1391] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:52.523180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ed89ef1c-63b2-4f88-acd3-e09edbf91b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:52.524088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ed89ef1c-63b2-4f88-acd3-e09edbf91b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:52.530438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed89ef1c-63b2-4f88-acd3-e09edbf91b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:52.530898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed89ef1c-63b2-4f88-acd3-e09edbf91b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:52.531670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed89ef1c-63b2-4f88-acd3-e09edbf91b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:52.532102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed89ef1c-63b2-4f88-acd3-e09edbf91b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:52.562073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ed89ef1c-63b2-4f88-acd3-e09edbf91b2b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042788 Mar 08 13:26:52.562644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 696/1392] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:52.644232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:52.644787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:52.650648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:52.651117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:52.651869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:52.652303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:52.786837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:52.801895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:52.803460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:52.804733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-01b3b271-01bd-4849-93dd-296eec4e6bf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.164442 Mar 08 13:26:52.805337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 697/1393] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:53.066746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:53.067352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:53.073810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.074306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.075107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.075664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.145223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:53.153160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9027b98a-ed3b-42e5-948d-4a9271a674cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.090170 Mar 08 13:26:53.153755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 697/1394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:53 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:53.516440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f0476662-27e8-46f4-b4e8-7ac5dbd96663 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:53.517382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f0476662-27e8-46f4-b4e8-7ac5dbd96663 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:53.524001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0476662-27e8-46f4-b4e8-7ac5dbd96663 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.527369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0476662-27e8-46f4-b4e8-7ac5dbd96663 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.527369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0476662-27e8-46f4-b4e8-7ac5dbd96663 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.527369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0476662-27e8-46f4-b4e8-7ac5dbd96663 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.556065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f0476662-27e8-46f4-b4e8-7ac5dbd96663 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043821 Mar 08 13:26:53.556621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 698/1395] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:53.572838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-80f9f7e4-7965-4184-a116-3de911afde9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:53.573973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-80f9f7e4-7965-4184-a116-3de911afde9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:53.580179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f9f7e4-7965-4184-a116-3de911afde9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.580625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f9f7e4-7965-4184-a116-3de911afde9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.581416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f9f7e4-7965-4184-a116-3de911afde9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.581849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f9f7e4-7965-4184-a116-3de911afde9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.610703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-80f9f7e4-7965-4184-a116-3de911afde9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041830 Mar 08 13:26:53.611171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 698/1396] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:53.823758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:53.824370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:53.830276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.830729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.831494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:53.831965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:53.961740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:53.970377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:53.971858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:53.973035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b2a60369-5b1f-427a-8ca3-2f1fb4f42aad tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153209 Mar 08 13:26:53.973594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 699/1397] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:54.170324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:54.170849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:54.176680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:54.177125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:54.177875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:54.178302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:54.236157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:54.243313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cc40e77b-3a7c-40fe-b38b-bf61556ca0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077727 Mar 08 13:26:54.243862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 699/1398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:54 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:54.567424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b4b20aac-99a4-4426-854c-65f04c471760 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:54.568356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b4b20aac-99a4-4426-854c-65f04c471760 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:54.574789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4b20aac-99a4-4426-854c-65f04c471760 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:54.575237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4b20aac-99a4-4426-854c-65f04c471760 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:54.575997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4b20aac-99a4-4426-854c-65f04c471760 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:54.576426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4b20aac-99a4-4426-854c-65f04c471760 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:54.603991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b4b20aac-99a4-4426-854c-65f04c471760 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040417 Mar 08 13:26:54.605399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 700/1399] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:54.621897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b4a2e1a2-896d-414b-9019-2535ef099f33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:54.622792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b4a2e1a2-896d-414b-9019-2535ef099f33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:54.629322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4a2e1a2-896d-414b-9019-2535ef099f33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:54.629761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4a2e1a2-896d-414b-9019-2535ef099f33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:54.630510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4a2e1a2-896d-414b-9019-2535ef099f33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:54.630939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4a2e1a2-896d-414b-9019-2535ef099f33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:54.659328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b4a2e1a2-896d-414b-9019-2535ef099f33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 Mar 08 13:26:54.659857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 700/1400] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:54.992091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:54.992747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:54.999199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:54.999644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.000649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:55.001108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.137848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:55.153838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:55.155949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:55.157158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-37c34311-509a-4602-8131-cc83aeb046ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.168970 Mar 08 13:26:55.158880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 701/1401] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:55.260780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:55.261299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:55.267039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:55.267486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.268237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:55.268683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.329963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:55.338924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a4342681-8d8c-468e-84db-f6d39e2a3fbc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081407 Mar 08 13:26:55.339529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 701/1402] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:55.616401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fe92bf0e-2bdc-4c7e-abfa-5f270a95ca27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:55.617289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fe92bf0e-2bdc-4c7e-abfa-5f270a95ca27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:55.623568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe92bf0e-2bdc-4c7e-abfa-5f270a95ca27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:55.624022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe92bf0e-2bdc-4c7e-abfa-5f270a95ca27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.624824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe92bf0e-2bdc-4c7e-abfa-5f270a95ca27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:55.625311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe92bf0e-2bdc-4c7e-abfa-5f270a95ca27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.654236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fe92bf0e-2bdc-4c7e-abfa-5f270a95ca27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Mar 08 13:26:55.654804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 702/1403] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:55.671083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-902b90af-549e-41a7-9344-b034444e6401 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:55.671983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-902b90af-549e-41a7-9344-b034444e6401 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:55.678261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902b90af-549e-41a7-9344-b034444e6401 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:55.678701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902b90af-549e-41a7-9344-b034444e6401 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.679451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902b90af-549e-41a7-9344-b034444e6401 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:55.679880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902b90af-549e-41a7-9344-b034444e6401 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:55.710297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-902b90af-549e-41a7-9344-b034444e6401 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Mar 08 13:26:55.710939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 702/1404] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:56.183091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:56.183712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:56.189780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.190260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.191029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.191472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.321281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:56.330096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:56.331637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:56.332898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e14d6d2e-6e5c-4a15-942a-bc1271f20867 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154622 Mar 08 13:26:56.333559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 703/1405] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:56.355673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:56.356279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:56.362097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.362544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.363310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.363745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.422897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:56.430097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-db41bb34-1b25-4a2a-adf4-4dc110f26fee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078822 Mar 08 13:26:56.430648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 703/1406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:56 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:56.668939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4c6129e5-5fd0-4d21-8891-ed45d1cf409a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:56.669771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4c6129e5-5fd0-4d21-8891-ed45d1cf409a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:56.676140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4c6129e5-5fd0-4d21-8891-ed45d1cf409a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.676784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4c6129e5-5fd0-4d21-8891-ed45d1cf409a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.677651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4c6129e5-5fd0-4d21-8891-ed45d1cf409a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.678090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4c6129e5-5fd0-4d21-8891-ed45d1cf409a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.708168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4c6129e5-5fd0-4d21-8891-ed45d1cf409a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Mar 08 13:26:56.709085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 704/1407] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:56.724640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-61d1c69a-1717-4e44-bffc-755e42eeb735 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:56.725628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-61d1c69a-1717-4e44-bffc-755e42eeb735 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:56.743895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61d1c69a-1717-4e44-bffc-755e42eeb735 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.744346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61d1c69a-1717-4e44-bffc-755e42eeb735 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.745718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61d1c69a-1717-4e44-bffc-755e42eeb735 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:56.746169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61d1c69a-1717-4e44-bffc-755e42eeb735 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:56.796467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-61d1c69a-1717-4e44-bffc-755e42eeb735 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076787 Mar 08 13:26:56.798010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 704/1408] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:57.351359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:57.352040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:57.357998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.358438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.359194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.359623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.447029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:57.448268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:57.454179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.454633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.455404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.455839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.490845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:57.499889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:57.501748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:57.502916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be9b2b94-9fe4-4d5d-a319-8e59b6bf8910 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155523 Mar 08 13:26:57.503503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 705/1409] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:57.515397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:57.522875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c05ac9cd-af99-4ac6-8cbd-df7bbeec4fff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079670 Mar 08 13:26:57.523427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 705/1410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:26:57.719623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a663fca3-0b38-4b76-9517-041df8c6b741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:57.720528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a663fca3-0b38-4b76-9517-041df8c6b741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:57.726783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a663fca3-0b38-4b76-9517-041df8c6b741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.727231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a663fca3-0b38-4b76-9517-041df8c6b741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.727990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a663fca3-0b38-4b76-9517-041df8c6b741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.728431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a663fca3-0b38-4b76-9517-041df8c6b741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.756834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a663fca3-0b38-4b76-9517-041df8c6b741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041116 Mar 08 13:26:57.757369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 706/1411] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:57.810657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2b0f4743-a61f-41f9-aebf-1a03f9f19782 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:57.811577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2b0f4743-a61f-41f9-aebf-1a03f9f19782 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:57.817831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b0f4743-a61f-41f9-aebf-1a03f9f19782 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.818282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b0f4743-a61f-41f9-aebf-1a03f9f19782 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.819040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b0f4743-a61f-41f9-aebf-1a03f9f19782 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:57.819476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b0f4743-a61f-41f9-aebf-1a03f9f19782 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:57.847000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2b0f4743-a61f-41f9-aebf-1a03f9f19782 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040779 Mar 08 13:26:57.847540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 706/1412] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:58.522093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:58.522754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:58.529393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.529849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.530657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.531090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.540469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:58.541250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:58.549018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.549461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.550227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.550640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.615046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:58.622795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7420ff09-3637-40d6-9be6-b4e217fbaa1b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087482 Mar 08 13:26:58.623396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 707/1413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:58.662622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:58.671699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:58.673232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:58.674381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c5851ed6-ded4-4596-9108-168b4803ed9d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156496 Mar 08 13:26:58.674931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 707/1414] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:26:58.768784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2e3f55d5-c8bf-48db-8b0c-df98c535034a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:58.769695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2e3f55d5-c8bf-48db-8b0c-df98c535034a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:58.775508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e3f55d5-c8bf-48db-8b0c-df98c535034a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.775974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e3f55d5-c8bf-48db-8b0c-df98c535034a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.776756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e3f55d5-c8bf-48db-8b0c-df98c535034a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.777188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e3f55d5-c8bf-48db-8b0c-df98c535034a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.805593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2e3f55d5-c8bf-48db-8b0c-df98c535034a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040758 Mar 08 13:26:58.806420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 708/1415] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:58.858015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3cbde3b9-7485-464c-b3a8-a0c39c930f38 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:58.868197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3cbde3b9-7485-464c-b3a8-a0c39c930f38 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:58.868197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cbde3b9-7485-464c-b3a8-a0c39c930f38 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.868197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cbde3b9-7485-464c-b3a8-a0c39c930f38 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.868197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cbde3b9-7485-464c-b3a8-a0c39c930f38 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:58.868598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cbde3b9-7485-464c-b3a8-a0c39c930f38 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:58.895427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3cbde3b9-7485-464c-b3a8-a0c39c930f38 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Mar 08 13:26:58.895974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 708/1416] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:26:59.639884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:59.640421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:59.646583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.647025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.647773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.648201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.693508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:59.694215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:59.701940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.702491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.703336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.703845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.707633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:59.714906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3b9aa4f2-9dba-4a30-b6ac-a4a7c35e11bf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079502 Mar 08 13:26:59.715589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 709/1417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:26:59 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:26:59.817966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ebcd9889-7eaf-43c2-92a7-81fd8d7f3a81 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:59.818898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ebcd9889-7eaf-43c2-92a7-81fd8d7f3a81 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:59.828107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebcd9889-7eaf-43c2-92a7-81fd8d7f3a81 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.828741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebcd9889-7eaf-43c2-92a7-81fd8d7f3a81 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.829508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebcd9889-7eaf-43c2-92a7-81fd8d7f3a81 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.829943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ebcd9889-7eaf-43c2-92a7-81fd8d7f3a81 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.839905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:59.850016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:59.861005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:26:59.861005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-14d104c7-6573-4411-a5fa-af9e409d3e12 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.163226 Mar 08 13:26:59.861005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 709/1418] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:26:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:26:59.861985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ebcd9889-7eaf-43c2-92a7-81fd8d7f3a81 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Mar 08 13:26:59.861985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 710/1419] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:26:59.906452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cccd00b7-7634-45ba-94fb-3330d8ba3ceb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:26:59.907318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cccd00b7-7634-45ba-94fb-3330d8ba3ceb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:26:59.913618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cccd00b7-7634-45ba-94fb-3330d8ba3ceb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.914069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cccd00b7-7634-45ba-94fb-3330d8ba3ceb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.914822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cccd00b7-7634-45ba-94fb-3330d8ba3ceb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:26:59.915255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cccd00b7-7634-45ba-94fb-3330d8ba3ceb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:26:59.942963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cccd00b7-7634-45ba-94fb-3330d8ba3ceb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040516 Mar 08 13:26:59.943500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 710/1420] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:26:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:00.731273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:00.731884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:00.738549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.739002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.739761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.740204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.801485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:00.809929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-623dd48d-4713-466d-9fcc-31fe5e68bf53 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082512 Mar 08 13:27:00.810498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 711/1421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:00 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:00.872014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9af1aefd-e101-4379-9825-be343a7f672f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:00.872989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9af1aefd-e101-4379-9825-be343a7f672f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:00.878889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:00.879442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9af1aefd-e101-4379-9825-be343a7f672f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.879573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:00.879910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9af1aefd-e101-4379-9825-be343a7f672f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.880765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9af1aefd-e101-4379-9825-be343a7f672f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.881211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9af1aefd-e101-4379-9825-be343a7f672f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.885593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.886041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.890027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.890027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.910875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9af1aefd-e101-4379-9825-be343a7f672f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Mar 08 13:27:00.911424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 711/1422] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:00.954602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-80298bb9-b1d8-4033-99c2-1821213b736b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:00.955505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-80298bb9-b1d8-4033-99c2-1821213b736b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:00.961717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80298bb9-b1d8-4033-99c2-1821213b736b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.962164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80298bb9-b1d8-4033-99c2-1821213b736b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.962923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80298bb9-b1d8-4033-99c2-1821213b736b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:00.963648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80298bb9-b1d8-4033-99c2-1821213b736b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:00.991959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-80298bb9-b1d8-4033-99c2-1821213b736b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041151 Mar 08 13:27:00.992436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 712/1423] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:01.018167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:01.026658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:01.028169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:01.029342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9c6aa3a7-baaa-401a-95b5-da0d3e8a5540 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154745 Mar 08 13:27:01.029892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 712/1424] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:00 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:27:01.827084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:01.827696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:01.833733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:01.834186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:01.834956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:01.835436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:01.902446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:01.910079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-05f96325-af1c-45c8-ae32-82c116f4d8ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087445 Mar 08 13:27:01.913202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 713/1425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:01.922932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a1fa73b8-2aa6-48d8-af62-419d95fed596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:01.923880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a1fa73b8-2aa6-48d8-af62-419d95fed596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:01.930454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1fa73b8-2aa6-48d8-af62-419d95fed596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:01.930905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1fa73b8-2aa6-48d8-af62-419d95fed596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:01.931672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1fa73b8-2aa6-48d8-af62-419d95fed596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:01.932647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1fa73b8-2aa6-48d8-af62-419d95fed596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:01.961294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a1fa73b8-2aa6-48d8-af62-419d95fed596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042313 Mar 08 13:27:01.961840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 713/1426] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:02.004346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-056458d5-730c-4859-96c3-f9db7793323b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:02.005338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-056458d5-730c-4859-96c3-f9db7793323b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:02.012230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-056458d5-730c-4859-96c3-f9db7793323b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.012706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-056458d5-730c-4859-96c3-f9db7793323b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.013487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-056458d5-730c-4859-96c3-f9db7793323b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.013927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-056458d5-730c-4859-96c3-f9db7793323b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.043292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-056458d5-730c-4859-96c3-f9db7793323b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Mar 08 13:27:02.043859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 714/1427] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:02.047170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:02.047781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:02.053592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.054043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.054804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.055245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.187154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:02.195297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:02.196822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:02.198153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f9851278-9ca0-43cb-bb12-f3cc2cf90e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154775 Mar 08 13:27:02.198741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 714/1428] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:27:02.927210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:02.927815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:02.934321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.934765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.935517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.935949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.972230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6fe6a581-6f82-40ef-a340-dad1b0446b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:02.973160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6fe6a581-6f82-40ef-a340-dad1b0446b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:02.979719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fe6a581-6f82-40ef-a340-dad1b0446b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.980227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fe6a581-6f82-40ef-a340-dad1b0446b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.981063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fe6a581-6f82-40ef-a340-dad1b0446b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:02.981497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6fe6a581-6f82-40ef-a340-dad1b0446b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:02.993638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:03.001747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-63a32787-f235-4103-a28f-c094722fb285 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078382 Mar 08 13:27:03.002312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 715/1429] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:03.012882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6fe6a581-6f82-40ef-a340-dad1b0446b5f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Mar 08 13:27:03.013425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 715/1430] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:03.054495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-00d09370-0925-4a67-93e3-5f52f33058c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:03.055431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-00d09370-0925-4a67-93e3-5f52f33058c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:03.062357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00d09370-0925-4a67-93e3-5f52f33058c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:03.062816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00d09370-0925-4a67-93e3-5f52f33058c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:03.063575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00d09370-0925-4a67-93e3-5f52f33058c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:03.064016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00d09370-0925-4a67-93e3-5f52f33058c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:03.091712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-00d09370-0925-4a67-93e3-5f52f33058c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041051 Mar 08 13:27:03.092262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 716/1431] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:03.216651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:03.217201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:03.224139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:03.224584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:03.225470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:03.225954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:03.512678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:03.520732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:03.522249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:03.523384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e06eeff2-fe01-42c0-a74d-b59fcf057e02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.311186 Mar 08 13:27:03.523925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 716/1432] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:04.019022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:04.019687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:04.025072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4f9fa600-acf4-4ee7-84b8-124bbb146592 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:04.025072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4f9fa600-acf4-4ee7-84b8-124bbb146592 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:04.026510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.027049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.027838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.028273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.030608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f9fa600-acf4-4ee7-84b8-124bbb146592 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.031052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f9fa600-acf4-4ee7-84b8-124bbb146592 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.031805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f9fa600-acf4-4ee7-84b8-124bbb146592 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.032231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f9fa600-acf4-4ee7-84b8-124bbb146592 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.061478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4f9fa600-acf4-4ee7-84b8-124bbb146592 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042108 Mar 08 13:27:04.062128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 717/1433] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:04.088198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:04.096305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6c2baf59-be9f-49c0-a968-8381737877b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081165 Mar 08 13:27:04.099750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 717/1434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:04.104509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f6d9aa66-d695-4737-b1f8-c4fc9bd1630c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:04.105461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f6d9aa66-d695-4737-b1f8-c4fc9bd1630c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:04.111290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6d9aa66-d695-4737-b1f8-c4fc9bd1630c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.111736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6d9aa66-d695-4737-b1f8-c4fc9bd1630c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.112498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6d9aa66-d695-4737-b1f8-c4fc9bd1630c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.112973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6d9aa66-d695-4737-b1f8-c4fc9bd1630c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.141038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f6d9aa66-d695-4737-b1f8-c4fc9bd1630c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040452 Mar 08 13:27:04.141567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 718/1435] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:04.542575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:04.543185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:04.549057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.549506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.550269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:04.550706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:04.679111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:04.687834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:04.689375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:04.690526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2204e5ec-a7d3-43de-b694-05a0b876b464 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152440 Mar 08 13:27:04.691078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 718/1436] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:05.073260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9709a435-f1a8-4d33-9dd3-dc385ce77cad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:05.074178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9709a435-f1a8-4d33-9dd3-dc385ce77cad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:05.080383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9709a435-f1a8-4d33-9dd3-dc385ce77cad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.080877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9709a435-f1a8-4d33-9dd3-dc385ce77cad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.081633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9709a435-f1a8-4d33-9dd3-dc385ce77cad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.082088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9709a435-f1a8-4d33-9dd3-dc385ce77cad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.110735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9709a435-f1a8-4d33-9dd3-dc385ce77cad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Mar 08 13:27:05.111277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 719/1437] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:05.113475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:05.114107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:05.120564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.121069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.121830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.122259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.153143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-233531f0-4195-40f5-b08b-e62b2e573a56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:05.154057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-233531f0-4195-40f5-b08b-e62b2e573a56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:05.159890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-233531f0-4195-40f5-b08b-e62b2e573a56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.160345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-233531f0-4195-40f5-b08b-e62b2e573a56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.161155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-233531f0-4195-40f5-b08b-e62b2e573a56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.161595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-233531f0-4195-40f5-b08b-e62b2e573a56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.185573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:05.190781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-233531f0-4195-40f5-b08b-e62b2e573a56 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042306 Mar 08 13:27:05.191338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 720/1438] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:05.194107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-798df48e-7a23-4a55-8727-617530af91b3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084486 Mar 08 13:27:05.194668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 719/1439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:05.708927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:05.709535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:05.715824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.716271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.717056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:05.717492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:05.848781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:05.857232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:05.866243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:05.866243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d9d9ab6a-024c-4df5-bd7c-0a80b6469b56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154916 Mar 08 13:27:05.866243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 721/1440] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:06.122977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-34de2a0d-13ef-4775-9575-3e4ea8c21679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:06.124072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-34de2a0d-13ef-4775-9575-3e4ea8c21679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:06.130679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34de2a0d-13ef-4775-9575-3e4ea8c21679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.131809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34de2a0d-13ef-4775-9575-3e4ea8c21679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:06.132050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34de2a0d-13ef-4775-9575-3e4ea8c21679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.132485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34de2a0d-13ef-4775-9575-3e4ea8c21679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:06.161491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-34de2a0d-13ef-4775-9575-3e4ea8c21679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Mar 08 13:27:06.162029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 720/1441] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:06.205605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ae642f91-8108-484b-bf02-39119d4d43f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:06.206578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ae642f91-8108-484b-bf02-39119d4d43f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:06.210161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:06.210772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:06.214686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae642f91-8108-484b-bf02-39119d4d43f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.215417 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae642f91-8108-484b-bf02-39119d4d43f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:06.216597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae642f91-8108-484b-bf02-39119d4d43f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.217048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.217226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae642f91-8108-484b-bf02-39119d4d43f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:06.217492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:06.218255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.218684 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:06.247150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ae642f91-8108-484b-bf02-39119d4d43f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049370 Mar 08 13:27:06.250639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 722/1442] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:06.277364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:06.284523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e748acdc-6ab8-44bf-81c8-581e11eff0cb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078314 Mar 08 13:27:06.285109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 721/1443] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:06 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:06.879474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:06.880077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:06.886619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.887068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:06.887823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:06.888257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:07.018240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:07.027163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:07.028652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:07.029887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b2b927c-5d73-4933-9c57-3a20897e6265 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154532 Mar 08 13:27:07.030491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 723/1444] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:07.173125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b44bdad4-49bd-4316-a4a9-197a2ac316f6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:07.173947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b44bdad4-49bd-4316-a4a9-197a2ac316f6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:07.180121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b44bdad4-49bd-4316-a4a9-197a2ac316f6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:07.180567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b44bdad4-49bd-4316-a4a9-197a2ac316f6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:07.181364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b44bdad4-49bd-4316-a4a9-197a2ac316f6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:07.182447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b44bdad4-49bd-4316-a4a9-197a2ac316f6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:07.209904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b44bdad4-49bd-4316-a4a9-197a2ac316f6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040823 Mar 08 13:27:07.210445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 722/1445] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:07.259634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-406a7c17-32bc-4b59-b44d-bb01c0094b60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:07.260847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-406a7c17-32bc-4b59-b44d-bb01c0094b60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:07.267088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-406a7c17-32bc-4b59-b44d-bb01c0094b60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:07.267536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-406a7c17-32bc-4b59-b44d-bb01c0094b60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:07.268304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-406a7c17-32bc-4b59-b44d-bb01c0094b60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:07.268767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-406a7c17-32bc-4b59-b44d-bb01c0094b60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:07.296858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-406a7c17-32bc-4b59-b44d-bb01c0094b60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041164 Mar 08 13:27:07.297426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 724/1446] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:07.302480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:07.303090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:07.308995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:07.309443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:07.310205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:07.310640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:07.368909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:07.376532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-30b849cc-86bb-4c03-8c3b-f94752159d8d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077918 Mar 08 13:27:07.377117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 723/1447] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:07 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:08.048047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:08.048676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:08.054644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.055090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.055851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.056283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.186888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:08.194963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:08.196453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:08.198202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3810a508-2df8-40da-bfcd-983165c35526 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153519 Mar 08 13:27:08.198743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 725/1448] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:08.221797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5adca537-ec80-4572-98ac-3ad0a9b99b51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:08.222709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5adca537-ec80-4572-98ac-3ad0a9b99b51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:08.228983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5adca537-ec80-4572-98ac-3ad0a9b99b51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.229440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5adca537-ec80-4572-98ac-3ad0a9b99b51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.230209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5adca537-ec80-4572-98ac-3ad0a9b99b51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.230651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5adca537-ec80-4572-98ac-3ad0a9b99b51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.259953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5adca537-ec80-4572-98ac-3ad0a9b99b51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040914 Mar 08 13:27:08.259953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 724/1449] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:08.307957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f79a4123-6bdb-483f-bffe-de228cd5f7cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:08.308939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f79a4123-6bdb-483f-bffe-de228cd5f7cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:08.315184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f79a4123-6bdb-483f-bffe-de228cd5f7cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.315624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f79a4123-6bdb-483f-bffe-de228cd5f7cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.316377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f79a4123-6bdb-483f-bffe-de228cd5f7cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.316839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f79a4123-6bdb-483f-bffe-de228cd5f7cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.345717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f79a4123-6bdb-483f-bffe-de228cd5f7cd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Mar 08 13:27:08.346265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 726/1450] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:08.393198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:08.393838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:08.400013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.400559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.401924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:08.402372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:08.459498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:08.467885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c91efd41-7dae-48be-a0a2-5d97d7074f49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078675 Mar 08 13:27:08.468449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 725/1451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:08 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:09.216819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:09.217431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:09.223285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.223735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.224517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.224958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.270518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d33d53e8-7a2a-46db-9af5-242c202175d2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:09.271429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d33d53e8-7a2a-46db-9af5-242c202175d2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:09.278328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d33d53e8-7a2a-46db-9af5-242c202175d2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.278777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d33d53e8-7a2a-46db-9af5-242c202175d2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.279541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d33d53e8-7a2a-46db-9af5-242c202175d2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.279971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d33d53e8-7a2a-46db-9af5-242c202175d2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.308778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d33d53e8-7a2a-46db-9af5-242c202175d2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041948 Mar 08 13:27:09.309133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 726/1452] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:09.356414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2dea5046-0415-4e9d-a578-543b8db9a2ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:09.357351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2dea5046-0415-4e9d-a578-543b8db9a2ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:09.359235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:09.363150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2dea5046-0415-4e9d-a578-543b8db9a2ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.363594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2dea5046-0415-4e9d-a578-543b8db9a2ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.364361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2dea5046-0415-4e9d-a578-543b8db9a2ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.364820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2dea5046-0415-4e9d-a578-543b8db9a2ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.367488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:09.369032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:09.370229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c29394c9-4ccb-42b5-8b9e-653132188efc tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158000 Mar 08 13:27:09.370772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 727/1453] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:09.392842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2dea5046-0415-4e9d-a578-543b8db9a2ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040416 Mar 08 13:27:09.393400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 727/1454] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:09.484580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:09.485179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:09.491050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.491492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.492241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:09.492682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:09.550671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:09.558586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1a67d351-a459-46df-a628-69b382cc717e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077863 Mar 08 13:27:09.559131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 728/1455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:10.321025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d60270b4-d2d6-468f-81a1-580e4d0ade75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:10.321845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d60270b4-d2d6-468f-81a1-580e4d0ade75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:10.330086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d60270b4-d2d6-468f-81a1-580e4d0ade75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.330536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d60270b4-d2d6-468f-81a1-580e4d0ade75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.331301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d60270b4-d2d6-468f-81a1-580e4d0ade75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.331790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d60270b4-d2d6-468f-81a1-580e4d0ade75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.360605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d60270b4-d2d6-468f-81a1-580e4d0ade75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Mar 08 13:27:10.361188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 728/1456] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:10.390798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:10.391442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:10.397885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.398683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.399684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.400121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.403998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4a1aac61-a735-453d-9766-7386316ed7c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:10.404933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4a1aac61-a735-453d-9766-7386316ed7c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:10.411087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a1aac61-a735-453d-9766-7386316ed7c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.411534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a1aac61-a735-453d-9766-7386316ed7c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.412305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a1aac61-a735-453d-9766-7386316ed7c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.412787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a1aac61-a735-453d-9766-7386316ed7c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.445100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4a1aac61-a735-453d-9766-7386316ed7c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045298 Mar 08 13:27:10.445685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 729/1457] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:10.574232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:10.577701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:10.578336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:10.582900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:10.584419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:10.584584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.585300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.585713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c73a2b21-552b-4dc3-9d00-4d3ed0b3c2d5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.200648 Mar 08 13:27:10.586278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:10.586428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 729/1458] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:10 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:10.586724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:10.661486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:10.672738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c7434b57-da5a-4b04-994a-144320abcf78 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.101270 Mar 08 13:27:10.673318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 730/1459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:11.372425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1760ac17-94d3-478a-ad21-7f0af376b8d8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:11.373361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1760ac17-94d3-478a-ad21-7f0af376b8d8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:11.379454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1760ac17-94d3-478a-ad21-7f0af376b8d8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.379896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1760ac17-94d3-478a-ad21-7f0af376b8d8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.380668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1760ac17-94d3-478a-ad21-7f0af376b8d8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.381106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1760ac17-94d3-478a-ad21-7f0af376b8d8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.409125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1760ac17-94d3-478a-ad21-7f0af376b8d8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040721 Mar 08 13:27:11.409727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 730/1460] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:11.459829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5aaeed4a-5cb3-40c1-b284-94f674086ce9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:11.460804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5aaeed4a-5cb3-40c1-b284-94f674086ce9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:11.467909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aaeed4a-5cb3-40c1-b284-94f674086ce9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.468359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aaeed4a-5cb3-40c1-b284-94f674086ce9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.469161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aaeed4a-5cb3-40c1-b284-94f674086ce9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.469598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5aaeed4a-5cb3-40c1-b284-94f674086ce9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.496877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5aaeed4a-5cb3-40c1-b284-94f674086ce9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040914 Mar 08 13:27:11.497418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 731/1461] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:11.607438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:11.607970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:11.613780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.614223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.614972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.615404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.690599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:11.691328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:11.697138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.698450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.699307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:11.699749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:11.749586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:11.758223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:11.758527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:11.759758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:11.761718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7b2b67b4-88ec-438e-89db-e6244470f0bb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158301 Mar 08 13:27:11.762540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 731/1462] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:11.766817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0eb78631-0da1-4a25-b4a0-5c3ab86b87d8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080068 Mar 08 13:27:11.767479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 732/1463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:11 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:12.420778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f6e38fc4-9f74-4603-88a8-c291f131bd24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:12.421696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f6e38fc4-9f74-4603-88a8-c291f131bd24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:12.427882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6e38fc4-9f74-4603-88a8-c291f131bd24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.428328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6e38fc4-9f74-4603-88a8-c291f131bd24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.429118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6e38fc4-9f74-4603-88a8-c291f131bd24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.429600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6e38fc4-9f74-4603-88a8-c291f131bd24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.457193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f6e38fc4-9f74-4603-88a8-c291f131bd24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 Mar 08 13:27:12.457730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 732/1464] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:12.508571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6f913a4c-4517-422e-bb1e-8fc453306e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:12.509527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6f913a4c-4517-422e-bb1e-8fc453306e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:12.515953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f913a4c-4517-422e-bb1e-8fc453306e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.516417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f913a4c-4517-422e-bb1e-8fc453306e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.517208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f913a4c-4517-422e-bb1e-8fc453306e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.522158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f913a4c-4517-422e-bb1e-8fc453306e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.546307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6f913a4c-4517-422e-bb1e-8fc453306e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041738 Mar 08 13:27:12.546853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 733/1465] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:12.780058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:12.780741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:12.783097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:12.783711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:12.786681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.787126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.787898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.788332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.789401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.789852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.790618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:12.791065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:12.853281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:12.860889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cebab62c-6b9f-4f84-a43c-da701c0742aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081566 Mar 08 13:27:12.861456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 734/1466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:12.921903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:12.930023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:12.931505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:12.932887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-12a1c0fd-b230-420b-a306-b80fc5693b1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157402 Mar 08 13:27:12.933451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 733/1467] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:27:13.469164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6fdc57fb-7fd5-4e09-937c-2a27ba0acc71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:13.470069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6fdc57fb-7fd5-4e09-937c-2a27ba0acc71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:13.475826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fdc57fb-7fd5-4e09-937c-2a27ba0acc71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.476271 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fdc57fb-7fd5-4e09-937c-2a27ba0acc71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:13.477070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fdc57fb-7fd5-4e09-937c-2a27ba0acc71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.477510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fdc57fb-7fd5-4e09-937c-2a27ba0acc71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:13.506163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6fdc57fb-7fd5-4e09-937c-2a27ba0acc71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040966 Mar 08 13:27:13.506699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 735/1468] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:13.558431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e6364966-b4c1-48dd-b271-30301e693147 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:13.559787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e6364966-b4c1-48dd-b271-30301e693147 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:13.566141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6364966-b4c1-48dd-b271-30301e693147 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.566608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6364966-b4c1-48dd-b271-30301e693147 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:13.567360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6364966-b4c1-48dd-b271-30301e693147 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.567797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e6364966-b4c1-48dd-b271-30301e693147 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:13.596207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e6364966-b4c1-48dd-b271-30301e693147 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041950 Mar 08 13:27:13.596765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 734/1469] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:13.877479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:13.878091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:13.884346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.885427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:13.886406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.886864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:13.945339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:13.951501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:13.952111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:13.953774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-13905124-2680-4a1f-a49d-6c890fa8c9cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080385 Mar 08 13:27:13.954364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 736/1470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:13.958024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.958476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:13.959248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:13.959687 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:14.097074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:14.105469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:14.106996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:14.108178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f4b92592-8ddb-41b1-accb-1daa255dea61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.161100 Mar 08 13:27:14.108751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 735/1471] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:27:14.517544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fc902f8d-5097-4e16-8afb-6bbbae15acc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:14.518454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fc902f8d-5097-4e16-8afb-6bbbae15acc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:14.524763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc902f8d-5097-4e16-8afb-6bbbae15acc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:14.525430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc902f8d-5097-4e16-8afb-6bbbae15acc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:14.526398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc902f8d-5097-4e16-8afb-6bbbae15acc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:14.526841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc902f8d-5097-4e16-8afb-6bbbae15acc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:14.555669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fc902f8d-5097-4e16-8afb-6bbbae15acc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 Mar 08 13:27:14.556207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 737/1472] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:14.608131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b222ed5-dbb0-4b54-a3af-662c52fb33fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:14.609017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b222ed5-dbb0-4b54-a3af-662c52fb33fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:14.615278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b222ed5-dbb0-4b54-a3af-662c52fb33fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:14.615728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b222ed5-dbb0-4b54-a3af-662c52fb33fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:14.616491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b222ed5-dbb0-4b54-a3af-662c52fb33fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:14.616950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b222ed5-dbb0-4b54-a3af-662c52fb33fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:14.646066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b222ed5-dbb0-4b54-a3af-662c52fb33fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042654 Mar 08 13:27:14.646595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 736/1473] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:14.970351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:14.970959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:14.976902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:14.977354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:14.978112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:14.978632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:15.037584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:15.046049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e189f4a5-ce20-4393-af57-07a48e9c8f4c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079609 Mar 08 13:27:15.046615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 738/1474] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:14 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:15.125701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:15.128186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:15.132052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:15.132504 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:15.133287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:15.133736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:15.283561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:15.291887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:15.293457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:15.294603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a4b808c3-b7a9-4413-b2d9-ed8a9e0ed658 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.173018 Mar 08 13:27:15.295148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 737/1475] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:15.445529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:27:15.445716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:27:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:27:15.567842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a41cb6d-d3bb-4225-8e9d-ec8e288735e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:15.569347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a41cb6d-d3bb-4225-8e9d-ec8e288735e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:15.578039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a41cb6d-d3bb-4225-8e9d-ec8e288735e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:15.578711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a41cb6d-d3bb-4225-8e9d-ec8e288735e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:15.579891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a41cb6d-d3bb-4225-8e9d-ec8e288735e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:15.580561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a41cb6d-d3bb-4225-8e9d-ec8e288735e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:15.612868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a41cb6d-d3bb-4225-8e9d-ec8e288735e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049180 Mar 08 13:27:15.613411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 739/1476] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:15.657227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c6c2591f-9934-4b8f-b388-622f65892ecb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:15.658158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c6c2591f-9934-4b8f-b388-622f65892ecb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:15.664366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6c2591f-9934-4b8f-b388-622f65892ecb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:15.664866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6c2591f-9934-4b8f-b388-622f65892ecb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:15.665622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6c2591f-9934-4b8f-b388-622f65892ecb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:15.666132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6c2591f-9934-4b8f-b388-622f65892ecb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:15.693817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c6c2591f-9934-4b8f-b388-622f65892ecb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040518 Mar 08 13:27:15.694350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 738/1477] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:16.063031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:16.063642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:16.069916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.070368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.071129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.071569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.131441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:16.139362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b43e214c-27e5-454b-887b-f684d712ab32 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080232 Mar 08 13:27:16.139926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 740/1478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:16.313392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:16.313914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:16.319819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.320437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.321229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.321661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.454238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:16.462460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:16.464848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:16.465995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-95e34098-b5a8-4ea3-8878-7dd20360d6d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156568 Mar 08 13:27:16.466553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 739/1479] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:16.624007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8ac0e0d1-e6b6-492b-87e0-ef7570d3e2af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:16.624866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8ac0e0d1-e6b6-492b-87e0-ef7570d3e2af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:16.630966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d1-e6b6-492b-87e0-ef7570d3e2af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.631408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d1-e6b6-492b-87e0-ef7570d3e2af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.632163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d1-e6b6-492b-87e0-ef7570d3e2af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.632623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d1-e6b6-492b-87e0-ef7570d3e2af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.660889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8ac0e0d1-e6b6-492b-87e0-ef7570d3e2af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 Mar 08 13:27:16.661417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 741/1480] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:16.704424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ba21cde6-b824-4a36-a9e4-38918cfc1439 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:16.705368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ba21cde6-b824-4a36-a9e4-38918cfc1439 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:16.711622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba21cde6-b824-4a36-a9e4-38918cfc1439 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.712079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba21cde6-b824-4a36-a9e4-38918cfc1439 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.712878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba21cde6-b824-4a36-a9e4-38918cfc1439 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:16.713857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ba21cde6-b824-4a36-a9e4-38918cfc1439 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:16.741006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ba21cde6-b824-4a36-a9e4-38918cfc1439 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040493 Mar 08 13:27:16.741543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 740/1481] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:17.155592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:17.156205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:17.162428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.162875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.163636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.164071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.225369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:17.229623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1d0962fe-1ff2-42a6-9798-b4053a680b3e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077960 Mar 08 13:27:17.230183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 742/1482] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:17 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:17.484377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:17.485007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:17.490859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.491310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.492074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.492511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.622086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:17.630666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:17.632178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:17.633386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e128302f-ee17-4c36-a06f-5f5f4a321b90 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152939 Mar 08 13:27:17.633935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 741/1483] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:17.672009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1ee6db35-6507-4b81-9837-0ea48511980a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:17.672959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1ee6db35-6507-4b81-9837-0ea48511980a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:17.678726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ee6db35-6507-4b81-9837-0ea48511980a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.679183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ee6db35-6507-4b81-9837-0ea48511980a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.679949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ee6db35-6507-4b81-9837-0ea48511980a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.680387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ee6db35-6507-4b81-9837-0ea48511980a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.707531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1ee6db35-6507-4b81-9837-0ea48511980a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039433 Mar 08 13:27:17.708066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 743/1484] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:17.752637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-54f8a788-0416-422a-81fa-fd3055f7d22c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:17.753570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-54f8a788-0416-422a-81fa-fd3055f7d22c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:17.759792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-54f8a788-0416-422a-81fa-fd3055f7d22c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.760316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-54f8a788-0416-422a-81fa-fd3055f7d22c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.761108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-54f8a788-0416-422a-81fa-fd3055f7d22c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:17.761547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-54f8a788-0416-422a-81fa-fd3055f7d22c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:17.788983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-54f8a788-0416-422a-81fa-fd3055f7d22c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040514 Mar 08 13:27:17.789507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 742/1485] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:18.246383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:18.247040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:18.253521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.253974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.254743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.255181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.315814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:18.323977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1a918fd3-f228-4175-9e39-99ac6cea5807 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081449 Mar 08 13:27:18.324540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 744/1486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:18.652487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:18.653042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:18.658887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.659336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.660100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.660647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.719172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6a44ca46-6044-495d-b759-a0d81b7ea10e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:18.720100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6a44ca46-6044-495d-b759-a0d81b7ea10e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:18.725759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a44ca46-6044-495d-b759-a0d81b7ea10e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.726205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a44ca46-6044-495d-b759-a0d81b7ea10e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.726965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a44ca46-6044-495d-b759-a0d81b7ea10e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.727400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a44ca46-6044-495d-b759-a0d81b7ea10e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.755717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6a44ca46-6044-495d-b759-a0d81b7ea10e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040544 Mar 08 13:27:18.759428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 745/1487] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:18.793243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:18.800391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-05edfbfc-6027-4872-8a1f-34a0c64552ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:18.801331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-05edfbfc-6027-4872-8a1f-34a0c64552ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:18.801540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:18.803056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:18.804211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-43b3a162-7219-497e-9c99-a0e478b9eb02 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155797 Mar 08 13:27:18.804773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 743/1488] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:18.808247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05edfbfc-6027-4872-8a1f-34a0c64552ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.808721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05edfbfc-6027-4872-8a1f-34a0c64552ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.809500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05edfbfc-6027-4872-8a1f-34a0c64552ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:18.809941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-05edfbfc-6027-4872-8a1f-34a0c64552ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:18.837637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-05edfbfc-6027-4872-8a1f-34a0c64552ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041127 Mar 08 13:27:18.838229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 746/1489] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:19.340890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:19.341416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:19.347317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.347763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.348958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.348958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.412332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:19.419998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf86b626-03e4-48ab-8b5b-1cff3421d76d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083235 Mar 08 13:27:19.420557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 744/1490] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:19.766721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-133a0012-ba6d-4b1b-ba8d-cb64f515cb24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:19.767624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-133a0012-ba6d-4b1b-ba8d-cb64f515cb24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:19.773927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-133a0012-ba6d-4b1b-ba8d-cb64f515cb24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.774379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-133a0012-ba6d-4b1b-ba8d-cb64f515cb24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.775138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-133a0012-ba6d-4b1b-ba8d-cb64f515cb24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.775654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-133a0012-ba6d-4b1b-ba8d-cb64f515cb24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.803453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-133a0012-ba6d-4b1b-ba8d-cb64f515cb24 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040728 Mar 08 13:27:19.803988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 747/1491] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:19.822901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:19.824408 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:19.829753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.830213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.830949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.831381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.848868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3fc9449a-65ea-4d7b-9c1d-3752fb07032d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:19.849771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3fc9449a-65ea-4d7b-9c1d-3752fb07032d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:19.856026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3fc9449a-65ea-4d7b-9c1d-3752fb07032d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.858638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3fc9449a-65ea-4d7b-9c1d-3752fb07032d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.858638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3fc9449a-65ea-4d7b-9c1d-3752fb07032d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:19.858638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3fc9449a-65ea-4d7b-9c1d-3752fb07032d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:19.887268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3fc9449a-65ea-4d7b-9c1d-3752fb07032d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Mar 08 13:27:19.887714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 748/1492] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:19.962099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:19.970795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:19.972282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:19.973457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9c9ec733-4cbc-4174-a34c-9cc79ab173d9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154688 Mar 08 13:27:19.974013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 745/1493] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:20.436922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:20.437528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:20.443345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.443788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:20.444539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.444998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:20.507851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:20.515801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-89329c1e-2a0c-459b-ae8d-838f5ce23f72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082868 Mar 08 13:27:20.516355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 749/1494] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:20 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:20.815470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-368d805f-e660-4569-93a1-4a99b33bca36 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:20.816416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-368d805f-e660-4569-93a1-4a99b33bca36 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:20.822863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-368d805f-e660-4569-93a1-4a99b33bca36 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.823325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-368d805f-e660-4569-93a1-4a99b33bca36 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:20.824094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-368d805f-e660-4569-93a1-4a99b33bca36 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.824529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-368d805f-e660-4569-93a1-4a99b33bca36 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:20.851984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-368d805f-e660-4569-93a1-4a99b33bca36 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040472 Mar 08 13:27:20.852514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 746/1495] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:20.898513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c82c90b8-f3f0-4a69-80c7-3c50668c66d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:20.899410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c82c90b8-f3f0-4a69-80c7-3c50668c66d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:20.906597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c82c90b8-f3f0-4a69-80c7-3c50668c66d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.907304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c82c90b8-f3f0-4a69-80c7-3c50668c66d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:20.908614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c82c90b8-f3f0-4a69-80c7-3c50668c66d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.909420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c82c90b8-f3f0-4a69-80c7-3c50668c66d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:20.942595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c82c90b8-f3f0-4a69-80c7-3c50668c66d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047954 Mar 08 13:27:20.943177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 750/1496] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:20.991158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:20.991771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:20.997675 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.998124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:20.998888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:20.999326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:21.127846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:21.137880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:21.139376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:21.140521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c2adba88-b748-4e75-9a45-48c509c420f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153275 Mar 08 13:27:21.141105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 747/1497] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:21.532326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:21.532958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:21.538861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:21.539300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:21.540059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:21.540489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:21.598304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:21.606006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1e8f4748-48bd-4c36-8bdc-41d3b2195e64 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077491 Mar 08 13:27:21.606551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 751/1498] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:21.868766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f9ca9cd8-7763-40cb-8593-3a064dfc51cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:21.868766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f9ca9cd8-7763-40cb-8593-3a064dfc51cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:21.871489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9ca9cd8-7763-40cb-8593-3a064dfc51cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:21.871932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9ca9cd8-7763-40cb-8593-3a064dfc51cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:21.872707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9ca9cd8-7763-40cb-8593-3a064dfc51cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:21.873145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9ca9cd8-7763-40cb-8593-3a064dfc51cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:21.903094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f9ca9cd8-7763-40cb-8593-3a064dfc51cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Mar 08 13:27:21.903657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 748/1499] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:21.953587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d634b323-c115-42c7-89ab-9c71be084267 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:21.954530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d634b323-c115-42c7-89ab-9c71be084267 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:21.960784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d634b323-c115-42c7-89ab-9c71be084267 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:21.961234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d634b323-c115-42c7-89ab-9c71be084267 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:21.961999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d634b323-c115-42c7-89ab-9c71be084267 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:21.962437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d634b323-c115-42c7-89ab-9c71be084267 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:21.991246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d634b323-c115-42c7-89ab-9c71be084267 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041616 Mar 08 13:27:21.991787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 752/1500] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:22.159303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:22.159861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:22.165684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:22.166392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:22.167164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:22.167601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:22.299556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:22.308237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:22.309815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:22.310966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ad8afa79-fc5a-4a7b-a2cd-774720537519 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155644 Mar 08 13:27:22.311538 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 749/1501] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:22.622681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:22.623319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:22.629540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:22.629988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:22.630747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:22.631182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:22.689215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:22.696475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bbdc44b6-379e-4ad1-94ef-837625d7320f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077755 Mar 08 13:27:22.697072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 753/1502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:22 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:22.914165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f734b5f7-5ccd-424e-998b-70ca2509858c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:22.915023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f734b5f7-5ccd-424e-998b-70ca2509858c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:22.921331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f734b5f7-5ccd-424e-998b-70ca2509858c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:22.921786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f734b5f7-5ccd-424e-998b-70ca2509858c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:22.922528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f734b5f7-5ccd-424e-998b-70ca2509858c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:22.922958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f734b5f7-5ccd-424e-998b-70ca2509858c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:22.959180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f734b5f7-5ccd-424e-998b-70ca2509858c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049004 Mar 08 13:27:22.959728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 750/1503] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:23.003563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6d5a8706-86b4-4c7e-a41d-6a5e72982750 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:23.004484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6d5a8706-86b4-4c7e-a41d-6a5e72982750 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:23.010702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d5a8706-86b4-4c7e-a41d-6a5e72982750 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.011153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d5a8706-86b4-4c7e-a41d-6a5e72982750 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:23.011911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d5a8706-86b4-4c7e-a41d-6a5e72982750 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.012350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d5a8706-86b4-4c7e-a41d-6a5e72982750 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:23.040096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6d5a8706-86b4-4c7e-a41d-6a5e72982750 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040678 Mar 08 13:27:23.040628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 754/1504] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:23.329104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:23.329689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:23.335549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.336036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:23.336945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.337383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:23.469392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:23.477539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:23.480286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:23.480776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b37202f8-ad21-43f9-a56b-da4cced419f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155554 Mar 08 13:27:23.481327 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 751/1505] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:23.714595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:23.715203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:23.721087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.721535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:23.722285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.722715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:23.780143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:23.787288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-679665d5-0cae-4e84-8acf-386c6a34944f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077219 Mar 08 13:27:23.787834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 755/1506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:23 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:23.971675 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-19d45bf6-ce0e-4f88-8fc3-dfa706f5ab28 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:23.972508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-19d45bf6-ce0e-4f88-8fc3-dfa706f5ab28 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:23.979356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-19d45bf6-ce0e-4f88-8fc3-dfa706f5ab28 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.979808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-19d45bf6-ce0e-4f88-8fc3-dfa706f5ab28 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:23.980575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-19d45bf6-ce0e-4f88-8fc3-dfa706f5ab28 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:23.981042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-19d45bf6-ce0e-4f88-8fc3-dfa706f5ab28 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:24.010100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-19d45bf6-ce0e-4f88-8fc3-dfa706f5ab28 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042201 Mar 08 13:27:24.010666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 752/1507] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:24.051406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-286d295d-4922-4ab5-9a74-f825591df85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:24.052310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-286d295d-4922-4ab5-9a74-f825591df85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:24.058594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-286d295d-4922-4ab5-9a74-f825591df85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:24.059050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-286d295d-4922-4ab5-9a74-f825591df85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:24.059791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-286d295d-4922-4ab5-9a74-f825591df85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:24.060223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-286d295d-4922-4ab5-9a74-f825591df85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:24.089765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-286d295d-4922-4ab5-9a74-f825591df85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Mar 08 13:27:24.090321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 756/1508] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:24.499282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:24.499882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:24.506046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:24.506489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:24.507235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:24.507663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:24.638694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:24.646817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:24.648305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:24.649471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ed466b76-3706-4458-b220-bfc552ff0fe1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154086 Mar 08 13:27:24.650045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 753/1509] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:24.803279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:24.803884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:24.810256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:24.810700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:24.811455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:24.811893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:24.869780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:24.877452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-945fe471-c489-47b4-8c90-42de8d5313db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078022 Mar 08 13:27:24.878181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 757/1510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:25.020724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0ba3ad99-7450-43c7-95e2-8a19380ba790 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:25.021670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0ba3ad99-7450-43c7-95e2-8a19380ba790 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:25.028129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ba3ad99-7450-43c7-95e2-8a19380ba790 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.028553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ba3ad99-7450-43c7-95e2-8a19380ba790 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.029341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ba3ad99-7450-43c7-95e2-8a19380ba790 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.029773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ba3ad99-7450-43c7-95e2-8a19380ba790 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.057689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0ba3ad99-7450-43c7-95e2-8a19380ba790 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040942 Mar 08 13:27:25.058219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 754/1511] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:25.101322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ae322ee1-95da-4034-aa26-137d048fa21c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:25.102237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ae322ee1-95da-4034-aa26-137d048fa21c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:25.109049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae322ee1-95da-4034-aa26-137d048fa21c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.109501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae322ee1-95da-4034-aa26-137d048fa21c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.110268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae322ee1-95da-4034-aa26-137d048fa21c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.110705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae322ee1-95da-4034-aa26-137d048fa21c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.139073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ae322ee1-95da-4034-aa26-137d048fa21c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041733 Mar 08 13:27:25.139621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 758/1512] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:25.668201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:25.668752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:25.674631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.675072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.675823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.676251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.804474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:25.813383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:25.814898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:25.816029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-97ce443d-5719-41a1-8cd3-e6ed62f886ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152488 Mar 08 13:27:25.816568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 755/1513] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:25.894021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:25.894749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:25.901103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.901724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.902485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:25.902924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:25.966118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:25.973492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-574375be-eaed-4223-8f12-11fee1b95d63 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083344 Mar 08 13:27:25.974053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 759/1514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:26.069061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3732527d-715c-4fd9-a7cc-9ff2f6b7c085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:26.069969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3732527d-715c-4fd9-a7cc-9ff2f6b7c085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:26.076523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3732527d-715c-4fd9-a7cc-9ff2f6b7c085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.077005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3732527d-715c-4fd9-a7cc-9ff2f6b7c085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:26.077760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3732527d-715c-4fd9-a7cc-9ff2f6b7c085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.078189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3732527d-715c-4fd9-a7cc-9ff2f6b7c085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:26.106997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3732527d-715c-4fd9-a7cc-9ff2f6b7c085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041965 Mar 08 13:27:26.107527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 756/1515] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:26.157065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fbd5bedc-d3df-40b4-a8ca-e6d5fe90b243 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:26.158009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fbd5bedc-d3df-40b4-a8ca-e6d5fe90b243 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:26.164210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbd5bedc-d3df-40b4-a8ca-e6d5fe90b243 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.165813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbd5bedc-d3df-40b4-a8ca-e6d5fe90b243 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:26.165813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbd5bedc-d3df-40b4-a8ca-e6d5fe90b243 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.166109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbd5bedc-d3df-40b4-a8ca-e6d5fe90b243 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:26.193971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fbd5bedc-d3df-40b4-a8ca-e6d5fe90b243 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040830 Mar 08 13:27:26.194521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 760/1516] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:26.739219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:27:26.739455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:27:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:27:26.834045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:26.834656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:26.841514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.841975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:26.842763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.843204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:26.974959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:26.984005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:26.985585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:26.986729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5fc6c3be-91da-44e3-9585-955aa5eabf1f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156602 Mar 08 13:27:26.987266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 757/1517] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:26.990235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:26.990805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:26.996931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.997382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:26.998178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:26.998589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:27.060266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:27.067513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4f47a29b-c05f-46a7-b4b8-3be93cf101d7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081320 Mar 08 13:27:27.068064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 761/1518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:27.117908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fc5739f9-4b40-4787-ad2d-9b88e10b34e4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:27.118816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fc5739f9-4b40-4787-ad2d-9b88e10b34e4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:27.125263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5739f9-4b40-4787-ad2d-9b88e10b34e4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:27.125974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5739f9-4b40-4787-ad2d-9b88e10b34e4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:27.126731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5739f9-4b40-4787-ad2d-9b88e10b34e4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:27.127165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc5739f9-4b40-4787-ad2d-9b88e10b34e4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:27.156070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fc5739f9-4b40-4787-ad2d-9b88e10b34e4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 Mar 08 13:27:27.156607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 758/1519] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:27.206190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cbdfb755-3113-49db-89f4-7e3f34845565 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:27.207131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cbdfb755-3113-49db-89f4-7e3f34845565 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:27.214040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbdfb755-3113-49db-89f4-7e3f34845565 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:27.214523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbdfb755-3113-49db-89f4-7e3f34845565 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:27.215317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbdfb755-3113-49db-89f4-7e3f34845565 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:27.215761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cbdfb755-3113-49db-89f4-7e3f34845565 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:27.243942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cbdfb755-3113-49db-89f4-7e3f34845565 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Mar 08 13:27:27.244677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 762/1520] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:28.005551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:28.006232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:28.012736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.013188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.013961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.014399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.084529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:28.085356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:28.091813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.092263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.093060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.093494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.148952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:28.158380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:28.159871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:28.161072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-20c26b2a-d13d-4184-b314-78530e7fe7fd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159568 Mar 08 13:27:28.161876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 759/1521] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:28.167677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-07bfc678-44a3-4b71-9a50-4e81c541c978 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:28.168603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-07bfc678-44a3-4b71-9a50-4e81c541c978 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:28.174914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07bfc678-44a3-4b71-9a50-4e81c541c978 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.175360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07bfc678-44a3-4b71-9a50-4e81c541c978 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.176130 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07bfc678-44a3-4b71-9a50-4e81c541c978 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.176561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07bfc678-44a3-4b71-9a50-4e81c541c978 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.207786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-07bfc678-44a3-4b71-9a50-4e81c541c978 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044100 Mar 08 13:27:28.208532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 760/1522] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:28.256359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-50a15f09-6720-4f61-879f-d0917edaabc0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:28.257220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-50a15f09-6720-4f61-879f-d0917edaabc0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:28.263622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50a15f09-6720-4f61-879f-d0917edaabc0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.266032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50a15f09-6720-4f61-879f-d0917edaabc0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.266032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50a15f09-6720-4f61-879f-d0917edaabc0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:28.266032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50a15f09-6720-4f61-879f-d0917edaabc0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:28.296410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-50a15f09-6720-4f61-879f-d0917edaabc0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Mar 08 13:27:28.297224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 761/1523] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:28.367145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:28.375282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-94b8d60b-8b52-4c0b-b067-eb10a27412d5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.294558 Mar 08 13:27:28.376121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 763/1524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:29.179266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:29.179914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:29.186420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.186867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.187625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.188061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.220079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c495455e-cc4d-4606-9b66-6c076d189551 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:29.221036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c495455e-cc4d-4606-9b66-6c076d189551 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:29.221528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:27:29.221710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 (ip 10.222.0.52) !!! Mar 08 13:27:29.228164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c495455e-cc4d-4606-9b66-6c076d189551 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.229665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c495455e-cc4d-4606-9b66-6c076d189551 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.230446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c495455e-cc4d-4606-9b66-6c076d189551 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.230882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c495455e-cc4d-4606-9b66-6c076d189551 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.259330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c495455e-cc4d-4606-9b66-6c076d189551 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 Mar 08 13:27:29.259987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 764/1525] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:29.308080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-baeb7e00-fccf-4850-ac41-1339dcd5974f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:29.309023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-baeb7e00-fccf-4850-ac41-1339dcd5974f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:29.314762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-baeb7e00-fccf-4850-ac41-1339dcd5974f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.315205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-baeb7e00-fccf-4850-ac41-1339dcd5974f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.315971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-baeb7e00-fccf-4850-ac41-1339dcd5974f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.316407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-baeb7e00-fccf-4850-ac41-1339dcd5974f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.318094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:29.327173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:29.328686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:29.329904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f7fd3093-ebfe-40cd-b237-2928cad4e849 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154570 Mar 08 13:27:29.330629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 762/1526] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:29.346657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-baeb7e00-fccf-4850-ac41-1339dcd5974f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Mar 08 13:27:29.347204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 765/1527] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:29.393104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:29.393750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:29.399658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.400121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.401509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:29.401946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:29.465293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:29.472545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-934934de-f787-4a5b-8547-0811a9b23c72 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083293 Mar 08 13:27:29.473122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 763/1528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:29 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:30.270806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b5f1622-b0a0-411e-9c33-2ac599dc0b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:30.271625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1b5f1622-b0a0-411e-9c33-2ac599dc0b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:30.278568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b5f1622-b0a0-411e-9c33-2ac599dc0b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.279021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b5f1622-b0a0-411e-9c33-2ac599dc0b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.279778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b5f1622-b0a0-411e-9c33-2ac599dc0b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.280212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b5f1622-b0a0-411e-9c33-2ac599dc0b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.307306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1b5f1622-b0a0-411e-9c33-2ac599dc0b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040582 Mar 08 13:27:30.307840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 766/1529] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:30.348261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:30.349017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:30.357985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.357985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.358276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.358429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a46ccfdd-6133-4f14-86fd-e157cb5f04fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:30.358699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.359429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a46ccfdd-6133-4f14-86fd-e157cb5f04fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:30.367745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46ccfdd-6133-4f14-86fd-e157cb5f04fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.368205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46ccfdd-6133-4f14-86fd-e157cb5f04fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.369017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46ccfdd-6133-4f14-86fd-e157cb5f04fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.369725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a46ccfdd-6133-4f14-86fd-e157cb5f04fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.398458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a46ccfdd-6133-4f14-86fd-e157cb5f04fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044017 Mar 08 13:27:30.399020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 767/1530] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:30.489208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:30.489931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:30.496294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.496890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.497658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:30.498113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:30.503841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:30.512629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:30.514143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:30.515283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5cc83f35-933c-4c7c-bd80-709c02df9763 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.171106 Mar 08 13:27:30.515824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 764/1531] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:30.557122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:30.564231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-53594d2d-71d5-48be-8e31-191f9012aa1c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078907 Mar 08 13:27:30.564810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 768/1532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:31.318759 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-62fc4afb-40d2-48b8-8ef5-6530580b12c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:31.319681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-62fc4afb-40d2-48b8-8ef5-6530580b12c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:31.325875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-62fc4afb-40d2-48b8-8ef5-6530580b12c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.326328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-62fc4afb-40d2-48b8-8ef5-6530580b12c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.327098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-62fc4afb-40d2-48b8-8ef5-6530580b12c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.327537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-62fc4afb-40d2-48b8-8ef5-6530580b12c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.365802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-62fc4afb-40d2-48b8-8ef5-6530580b12c5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050941 Mar 08 13:27:31.366472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 765/1533] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:31.410772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a958a3ca-7b92-49c9-9c73-31c5865e3b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:31.411697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a958a3ca-7b92-49c9-9c73-31c5865e3b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:31.418490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a958a3ca-7b92-49c9-9c73-31c5865e3b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.418942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a958a3ca-7b92-49c9-9c73-31c5865e3b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.419712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a958a3ca-7b92-49c9-9c73-31c5865e3b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.420155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a958a3ca-7b92-49c9-9c73-31c5865e3b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.448831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a958a3ca-7b92-49c9-9c73-31c5865e3b3d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042126 Mar 08 13:27:31.449383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 769/1534] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:31.533796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:31.534400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:31.540714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.541818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.542632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.543062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.581131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:31.581659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:31.587435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.588741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.589522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:31.589951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:31.647877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:31.655778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-236c39dc-ae19-4be5-b2c0-a0d30333a8f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078872 Mar 08 13:27:31.656556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 770/1535] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:31 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:31.672696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:31.685925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:31.687417 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:31.688586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-52e3b699-7b2f-4681-a201-82224ed5eed3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158668 Mar 08 13:27:31.689165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 766/1536] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:32.377927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-632398b4-c602-4baa-a4e9-2e4875b0034c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:32.378826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-632398b4-c602-4baa-a4e9-2e4875b0034c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:32.384722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-632398b4-c602-4baa-a4e9-2e4875b0034c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.385172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-632398b4-c602-4baa-a4e9-2e4875b0034c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.385924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-632398b4-c602-4baa-a4e9-2e4875b0034c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.386356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-632398b4-c602-4baa-a4e9-2e4875b0034c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.413230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-632398b4-c602-4baa-a4e9-2e4875b0034c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039474 Mar 08 13:27:32.413833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 771/1537] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:32.459427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1632ebba-ec9d-4468-b283-b4cbc2faa299 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:32.460367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1632ebba-ec9d-4468-b283-b4cbc2faa299 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:32.466413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1632ebba-ec9d-4468-b283-b4cbc2faa299 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.466865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1632ebba-ec9d-4468-b283-b4cbc2faa299 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.467631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1632ebba-ec9d-4468-b283-b4cbc2faa299 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.468069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1632ebba-ec9d-4468-b283-b4cbc2faa299 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.496520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1632ebba-ec9d-4468-b283-b4cbc2faa299 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041159 Mar 08 13:27:32.497090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 767/1538] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:32.672142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:32.672692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:32.678891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.679337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.680092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.680524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.714340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:32.715096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:32.721152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.721620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.722406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:32.722844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:32.740289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:32.747753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d013915f-38cd-47dc-8bdc-b55280348aa3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079561 Mar 08 13:27:32.748324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 772/1539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:32 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:32.859622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:32.868032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:32.870113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:32.873045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6c6d00f5-149f-42f4-ad45-b9363dccfea8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.166543 Mar 08 13:27:32.873045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 768/1540] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:32 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:27:33.425226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9dcce3b9-9124-4fb5-8ba9-3ac74c1b3143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:33.426125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9dcce3b9-9124-4fb5-8ba9-3ac74c1b3143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:33.432001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9dcce3b9-9124-4fb5-8ba9-3ac74c1b3143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.432464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9dcce3b9-9124-4fb5-8ba9-3ac74c1b3143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:33.433231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9dcce3b9-9124-4fb5-8ba9-3ac74c1b3143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.433667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9dcce3b9-9124-4fb5-8ba9-3ac74c1b3143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:33.460813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9dcce3b9-9124-4fb5-8ba9-3ac74c1b3143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039463 Mar 08 13:27:33.461354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 773/1541] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:33.507599 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f1b9f1ee-62c5-40f9-91bb-d99f2844de49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:33.508517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f1b9f1ee-62c5-40f9-91bb-d99f2844de49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:33.514807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1b9f1ee-62c5-40f9-91bb-d99f2844de49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.515263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1b9f1ee-62c5-40f9-91bb-d99f2844de49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:33.516027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1b9f1ee-62c5-40f9-91bb-d99f2844de49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.516467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1b9f1ee-62c5-40f9-91bb-d99f2844de49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:33.544915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f1b9f1ee-62c5-40f9-91bb-d99f2844de49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Mar 08 13:27:33.545455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 769/1542] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:33.764972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:33.765581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:33.771877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.772320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:33.773153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.773588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:33.833381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:33.840737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-76ddfd35-3f3e-4479-9153-953fe3ac6b38 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079633 Mar 08 13:27:33.841289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 774/1543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:33 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:33.889828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:33.890441 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:33.896276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.900509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:33.900509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:33.900509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:34.031951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:34.040403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:34.042636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:34.043781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0f0393f6-c5fc-4afb-af1e-e0624232b8af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157962 Mar 08 13:27:34.044324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 770/1544] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:34.472942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1e33679b-a112-4dc2-96ba-e21975205c51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:34.473846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1e33679b-a112-4dc2-96ba-e21975205c51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:34.480195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e33679b-a112-4dc2-96ba-e21975205c51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:34.480636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e33679b-a112-4dc2-96ba-e21975205c51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:34.481411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e33679b-a112-4dc2-96ba-e21975205c51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:34.481843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e33679b-a112-4dc2-96ba-e21975205c51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:34.508850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1e33679b-a112-4dc2-96ba-e21975205c51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039923 Mar 08 13:27:34.509397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 775/1545] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:34.556084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8abc6175-7d7c-4388-9823-49b7769e10c2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:34.557068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8abc6175-7d7c-4388-9823-49b7769e10c2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:34.563250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8abc6175-7d7c-4388-9823-49b7769e10c2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:34.563699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8abc6175-7d7c-4388-9823-49b7769e10c2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:34.564461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8abc6175-7d7c-4388-9823-49b7769e10c2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:34.564937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8abc6175-7d7c-4388-9823-49b7769e10c2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:34.593514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8abc6175-7d7c-4388-9823-49b7769e10c2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Mar 08 13:27:34.594048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 771/1546] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:34.857170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:34.857786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:34.866912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:34.866912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:34.866912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:34.866912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:34.924780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:34.932878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b1baccee-9bae-4102-a9be-25d6b26590c8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079414 Mar 08 13:27:34.933451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 776/1547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:34 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:35.062022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:35.062766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:35.068569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.069053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:35.069809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.070243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:35.203933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:35.212251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:35.214393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:35.215550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-802a8d31-e4ad-44d8-bde6-63a159a92986 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.157455 Mar 08 13:27:35.216098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 772/1548] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:35.519457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-003693e0-5b49-4ab6-a6a9-82cd986e2560 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:35.520369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-003693e0-5b49-4ab6-a6a9-82cd986e2560 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:35.526952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-003693e0-5b49-4ab6-a6a9-82cd986e2560 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.527400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-003693e0-5b49-4ab6-a6a9-82cd986e2560 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:35.528159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-003693e0-5b49-4ab6-a6a9-82cd986e2560 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.528597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-003693e0-5b49-4ab6-a6a9-82cd986e2560 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:35.555665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-003693e0-5b49-4ab6-a6a9-82cd986e2560 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040121 Mar 08 13:27:35.556212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 777/1549] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:35.605447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b0034865-5a0f-460a-bd64-5db88384429d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:35.606359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b0034865-5a0f-460a-bd64-5db88384429d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:35.612571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b0034865-5a0f-460a-bd64-5db88384429d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.613055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b0034865-5a0f-460a-bd64-5db88384429d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:35.613813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b0034865-5a0f-460a-bd64-5db88384429d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.614250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b0034865-5a0f-460a-bd64-5db88384429d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:35.642282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b0034865-5a0f-460a-bd64-5db88384429d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040942 Mar 08 13:27:35.642815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 773/1550] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:35.950081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:35.950704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:35.956978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.957433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:35.958197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:35.958638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:36.018079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:36.025453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-79b3a86e-fa41-4fd0-92e4-70ae86937c77 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079891 Mar 08 13:27:36.026471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 778/1551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:35 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:36.234801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:36.235360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:36.241205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:36.241653 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:36.242416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:36.242849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:36.374956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:36.383410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:36.384965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:36.386092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-57bf5079-cb16-43e7-8f62-cb6fb36eaa5f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.155295 Mar 08 13:27:36.386642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 774/1552] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:36.567494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6cef6d5b-a726-485a-a349-2c3ad15f5031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:36.568360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6cef6d5b-a726-485a-a349-2c3ad15f5031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:36.574259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cef6d5b-a726-485a-a349-2c3ad15f5031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:36.574705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cef6d5b-a726-485a-a349-2c3ad15f5031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:36.575470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cef6d5b-a726-485a-a349-2c3ad15f5031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:36.575903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cef6d5b-a726-485a-a349-2c3ad15f5031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:36.604125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6cef6d5b-a726-485a-a349-2c3ad15f5031 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040040 Mar 08 13:27:36.604694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 779/1553] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:36.654123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-71a59ba6-54fa-4470-a0ed-203da9ad214a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:36.655045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-71a59ba6-54fa-4470-a0ed-203da9ad214a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:36.661299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71a59ba6-54fa-4470-a0ed-203da9ad214a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:36.661748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71a59ba6-54fa-4470-a0ed-203da9ad214a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:36.662513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71a59ba6-54fa-4470-a0ed-203da9ad214a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:36.662949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71a59ba6-54fa-4470-a0ed-203da9ad214a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:36.691458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-71a59ba6-54fa-4470-a0ed-203da9ad214a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041833 Mar 08 13:27:36.691988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 775/1554] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:37.043264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:37.043879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:37.050170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.050627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.051395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.051840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.109531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:37.116673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3090fc5d-43af-479d-82d7-347fc5dbb649 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077923 Mar 08 13:27:37.117235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 780/1555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:37 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:37.404131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:37.404769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:37.410731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.411181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.411948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.412381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.543301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:37.551559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:37.553099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:37.554247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8ccaf38a-798f-4356-9d76-cb2a1ba6acba tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.154781 Mar 08 13:27:37.554800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 776/1556] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:37 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:37.615407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-945e0f03-6faf-4db6-941f-7ab6e487f9d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:37.616243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-945e0f03-6faf-4db6-941f-7ab6e487f9d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:37.622053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945e0f03-6faf-4db6-941f-7ab6e487f9d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.622497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945e0f03-6faf-4db6-941f-7ab6e487f9d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.623250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945e0f03-6faf-4db6-941f-7ab6e487f9d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.623682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-945e0f03-6faf-4db6-941f-7ab6e487f9d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.653393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-945e0f03-6faf-4db6-941f-7ab6e487f9d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 Mar 08 13:27:37.653931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 781/1557] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:37.702684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-73db64fa-eaff-44a9-8c7a-91905bc59dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:37.703592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-73db64fa-eaff-44a9-8c7a-91905bc59dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:37.709821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73db64fa-eaff-44a9-8c7a-91905bc59dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.710268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73db64fa-eaff-44a9-8c7a-91905bc59dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.711024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73db64fa-eaff-44a9-8c7a-91905bc59dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:37.711457 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73db64fa-eaff-44a9-8c7a-91905bc59dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:37.739354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-73db64fa-eaff-44a9-8c7a-91905bc59dc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 Mar 08 13:27:37.739879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 777/1558] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:38.134054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:38.135347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:38.141561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.142014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.142775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.143212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.202898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:38.210091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0537e112-a5dc-4132-8a78-58f29e64375e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080028 Mar 08 13:27:38.210638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 782/1559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:38 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:38.572897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:38.573500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:38.579362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.579811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.580570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.581104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.665007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-605219d4-4335-4b30-a104-28eecba8d9da tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:38.665955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-605219d4-4335-4b30-a104-28eecba8d9da tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:38.671816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-605219d4-4335-4b30-a104-28eecba8d9da tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.672264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-605219d4-4335-4b30-a104-28eecba8d9da tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.673058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-605219d4-4335-4b30-a104-28eecba8d9da tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.673496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-605219d4-4335-4b30-a104-28eecba8d9da tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.702385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-605219d4-4335-4b30-a104-28eecba8d9da tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041395 Mar 08 13:27:38.702940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 783/1560] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:38.716986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:38.725103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:38.726609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:38.727766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e431d92a-7178-400c-965d-79cb37f8e549 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159299 Mar 08 13:27:38.728515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 778/1561] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:38 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:38.750945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4525a53a-e66a-4276-9a7a-b13a85ca774e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:38.751839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4525a53a-e66a-4276-9a7a-b13a85ca774e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:38.757560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4525a53a-e66a-4276-9a7a-b13a85ca774e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.758012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4525a53a-e66a-4276-9a7a-b13a85ca774e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.758765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4525a53a-e66a-4276-9a7a-b13a85ca774e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:38.759194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4525a53a-e66a-4276-9a7a-b13a85ca774e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:38.786582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4525a53a-e66a-4276-9a7a-b13a85ca774e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039745 Mar 08 13:27:38.787117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 784/1562] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:39.226728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:39.227342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:39.233911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.234362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.235160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.235599 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.294332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:39.301671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-948f0b33-e9a8-48b2-acf5-ada9e2a550a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078876 Mar 08 13:27:39.302220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 779/1563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:39 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:39.714660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-31805679-6d9b-4b43-88ad-739027f17143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:39.715601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-31805679-6d9b-4b43-88ad-739027f17143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:39.730880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31805679-6d9b-4b43-88ad-739027f17143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.731361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31805679-6d9b-4b43-88ad-739027f17143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.732146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31805679-6d9b-4b43-88ad-739027f17143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.732583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31805679-6d9b-4b43-88ad-739027f17143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.746021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:39.746625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:39.753084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.753531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.754293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.754731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.762972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-31805679-6d9b-4b43-88ad-739027f17143 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053026 Mar 08 13:27:39.763536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 785/1564] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:39.798158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c181cf15-6dc9-4910-95ea-84a76698c5fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:39.799068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c181cf15-6dc9-4910-95ea-84a76698c5fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:39.804862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c181cf15-6dc9-4910-95ea-84a76698c5fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.805305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c181cf15-6dc9-4910-95ea-84a76698c5fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.806084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c181cf15-6dc9-4910-95ea-84a76698c5fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:39.807195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c181cf15-6dc9-4910-95ea-84a76698c5fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:39.833368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:27:39.833576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments (ip 10.222.0.52) !!! Mar 08 13:27:39.836318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c181cf15-6dc9-4910-95ea-84a76698c5fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042151 Mar 08 13:27:39.842307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 786/1565] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:39.894517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:39.902851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:39.904446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:39.905622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-15719659-01c2-4002-955b-ebbe18669ce0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.164015 Mar 08 13:27:39.906178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 780/1566] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:27:40.317980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:40.318515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:40.324406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.324892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:40.325662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.326128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:40.388797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:40.396024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-330d6781-a9cc-49dc-925f-63d76e2fd267 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081991 Mar 08 13:27:40.396569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 787/1567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:40 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:40.774571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-601303e0-51d1-432c-9f8c-bf3c4e6dfa66 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:40.775517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-601303e0-51d1-432c-9f8c-bf3c4e6dfa66 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:40.782693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-601303e0-51d1-432c-9f8c-bf3c4e6dfa66 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.783137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-601303e0-51d1-432c-9f8c-bf3c4e6dfa66 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:40.783901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-601303e0-51d1-432c-9f8c-bf3c4e6dfa66 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.784332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-601303e0-51d1-432c-9f8c-bf3c4e6dfa66 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:40.811666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-601303e0-51d1-432c-9f8c-bf3c4e6dfa66 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041066 Mar 08 13:27:40.812211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 781/1568] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:40.847573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-541af075-3a54-4cb7-8049-84b67ff72a04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:40.848526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-541af075-3a54-4cb7-8049-84b67ff72a04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:40.854848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-541af075-3a54-4cb7-8049-84b67ff72a04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.855300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-541af075-3a54-4cb7-8049-84b67ff72a04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:40.856072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-541af075-3a54-4cb7-8049-84b67ff72a04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.856508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-541af075-3a54-4cb7-8049-84b67ff72a04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:40.885080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-541af075-3a54-4cb7-8049-84b67ff72a04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040848 Mar 08 13:27:40.885629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 788/1569] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:40.924244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:40.924881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:40.930713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.931702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:40.932484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:40.932937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:41.062300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:41.070348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:41.072494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:41.073673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6e047cd4-2dc9-42fd-9656-f049a601a660 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153317 Mar 08 13:27:41.074228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 782/1570] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:41.416365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:41.417336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:41.425874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:41.426550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:41.427718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:41.428385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:41.496829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:41.504340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d89bc712-9ede-46fb-a599-dcae94e0aed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.094778 Mar 08 13:27:41.504927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 789/1571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:41.823197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-87897e9c-4727-482f-b494-90badced828f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:41.824101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-87897e9c-4727-482f-b494-90badced828f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:41.830340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87897e9c-4727-482f-b494-90badced828f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:41.830815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87897e9c-4727-482f-b494-90badced828f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:41.831577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87897e9c-4727-482f-b494-90badced828f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:41.831998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87897e9c-4727-482f-b494-90badced828f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:41.867317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-87897e9c-4727-482f-b494-90badced828f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Mar 08 13:27:41.867317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 783/1572] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:41.896613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bad12831-16ce-405c-a999-633f6510d70b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:41.897548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bad12831-16ce-405c-a999-633f6510d70b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:41.904199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bad12831-16ce-405c-a999-633f6510d70b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:41.904665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bad12831-16ce-405c-a999-633f6510d70b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:41.905462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bad12831-16ce-405c-a999-633f6510d70b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:41.905900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bad12831-16ce-405c-a999-633f6510d70b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:41.935043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bad12831-16ce-405c-a999-633f6510d70b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042465 Mar 08 13:27:41.935588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 790/1573] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:42.091282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:42.091887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:42.097671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.098116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.098873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.099300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.227760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:42.237262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:42.238742 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:42.239893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e881be54-37fe-4f8f-8c40-3a708d985c8a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.152576 Mar 08 13:27:42.240434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 784/1574] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:42.521641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:42.522339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:42.528893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.529341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.530100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.530530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.588796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:42.596549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d8831919-fea0-4725-bec0-a879a65f0399 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078946 Mar 08 13:27:42.597168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 791/1575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:42.877746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7635fad5-24a3-449a-9bf8-6f1d15a2333c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:42.878589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7635fad5-24a3-449a-9bf8-6f1d15a2333c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:42.885103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7635fad5-24a3-449a-9bf8-6f1d15a2333c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.885551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7635fad5-24a3-449a-9bf8-6f1d15a2333c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.886368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7635fad5-24a3-449a-9bf8-6f1d15a2333c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.886800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7635fad5-24a3-449a-9bf8-6f1d15a2333c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.914152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7635fad5-24a3-449a-9bf8-6f1d15a2333c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040560 Mar 08 13:27:42.914691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 785/1576] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:42.946544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1f438b40-04b5-43b8-85df-dc37be1ed9b9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:42.947817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1f438b40-04b5-43b8-85df-dc37be1ed9b9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:42.954438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f438b40-04b5-43b8-85df-dc37be1ed9b9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.954878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f438b40-04b5-43b8-85df-dc37be1ed9b9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.955637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f438b40-04b5-43b8-85df-dc37be1ed9b9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:42.956066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f438b40-04b5-43b8-85df-dc37be1ed9b9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:42.990415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1f438b40-04b5-43b8-85df-dc37be1ed9b9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047749 Mar 08 13:27:42.990955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 792/1577] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:43.258052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:43.258659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:43.264645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:43.265121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:43.265880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:43.266323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:43.402363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:43.410509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:43.412020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:43.413215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-93663b40-7997-4978-b8cf-c70a35703f80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159124 Mar 08 13:27:43.413766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 786/1578] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:43.624722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:43.625506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:43.631401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:43.631874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:43.632733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:43.633196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:43.691343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:43.699539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eef48650-28af-4bb4-83b0-91df8adb98ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078888 Mar 08 13:27:43.700082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 793/1579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:43 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:43.926304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b55cb307-2726-4580-8a9b-68407f74d66b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:43.927217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b55cb307-2726-4580-8a9b-68407f74d66b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:43.934451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55cb307-2726-4580-8a9b-68407f74d66b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:43.934906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55cb307-2726-4580-8a9b-68407f74d66b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:43.935676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55cb307-2726-4580-8a9b-68407f74d66b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:43.936133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55cb307-2726-4580-8a9b-68407f74d66b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:43.965009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b55cb307-2726-4580-8a9b-68407f74d66b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042659 Mar 08 13:27:43.965553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 787/1580] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:44.002350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8dbcaee6-d40a-42c1-b7e8-3d26467a33d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:44.006510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8dbcaee6-d40a-42c1-b7e8-3d26467a33d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:44.010061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8dbcaee6-d40a-42c1-b7e8-3d26467a33d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.010514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8dbcaee6-d40a-42c1-b7e8-3d26467a33d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:44.011575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8dbcaee6-d40a-42c1-b7e8-3d26467a33d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.011772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8dbcaee6-d40a-42c1-b7e8-3d26467a33d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:44.041248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8dbcaee6-d40a-42c1-b7e8-3d26467a33d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042883 Mar 08 13:27:44.041807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 794/1581] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:44.432629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:44.433280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:44.439106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.439549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:44.440300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.440764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:44.570686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:44.579193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:44.580685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:44.581831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-baeeffbc-0274-4752-9b1b-114c12fa2ef0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.153666 Mar 08 13:27:44.582382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 788/1582] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:44.715790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:44.716404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:44.722300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.722751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:44.723520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.723961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:44.782115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:44.789323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1e64d223-da64-4e73-87b1-0bc33acfd7fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078040 Mar 08 13:27:44.789876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 795/1583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:44 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:44.976613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b3eb2136-16ad-4246-b089-04bf60248349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:44.977471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b3eb2136-16ad-4246-b089-04bf60248349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:44.984517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3eb2136-16ad-4246-b089-04bf60248349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.985000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3eb2136-16ad-4246-b089-04bf60248349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:44.985751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3eb2136-16ad-4246-b089-04bf60248349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:44.986179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3eb2136-16ad-4246-b089-04bf60248349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:45.013929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b3eb2136-16ad-4246-b089-04bf60248349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041370 Mar 08 13:27:45.014472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 789/1584] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:45.053390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-59b90f9e-4173-4897-a2bb-3658c6c9fbc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:27:45.054309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-59b90f9e-4173-4897-a2bb-3658c6c9fbc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:45.060280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59b90f9e-4173-4897-a2bb-3658c6c9fbc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:45.060768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59b90f9e-4173-4897-a2bb-3658c6c9fbc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:45.061543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59b90f9e-4173-4897-a2bb-3658c6c9fbc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:45.061984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59b90f9e-4173-4897-a2bb-3658c6c9fbc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:45.140849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-59b90f9e-4173-4897-a2bb-3658c6c9fbc2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action" status: 200 len: 102163 microversion: 2.1 time: 0.091075 Mar 08 13:27:45.141504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 796/1585] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:27:45 2022] POST /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de/action => generated 102163 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:45.599683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:45.600233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:45.606190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:45.606633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:45.607377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:45.607806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:45.742316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:45.751273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:45.752792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:45.753934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3232c99e-8a2f-43d0-aa61-616c8f7ef96c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.158268 Mar 08 13:27:45.754477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 790/1586] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:45.808028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:45.808796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:45.816331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:45.816799 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:45.817572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:45.818226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:45.878772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:45.886669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3cece0a1-9be3-4e87-b63e-2c27cd26f696 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083606 Mar 08 13:27:45.887212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 797/1587] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:45 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:46.025856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f8c3f75-2f0b-40ec-b80e-6223347e7524 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:46.026778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f8c3f75-2f0b-40ec-b80e-6223347e7524 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:46.033102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f8c3f75-2f0b-40ec-b80e-6223347e7524 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:46.033556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f8c3f75-2f0b-40ec-b80e-6223347e7524 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:46.034349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f8c3f75-2f0b-40ec-b80e-6223347e7524 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:46.034793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f8c3f75-2f0b-40ec-b80e-6223347e7524 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:46.064162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f8c3f75-2f0b-40ec-b80e-6223347e7524 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Mar 08 13:27:46.064713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 791/1588] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:46.773233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:46.773912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:46.781064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:46.781510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:46.782276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:46.782709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:46.903477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:46.904167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:46.910476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:46.911002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:46.911865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:46.912373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:46.917425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:46.925763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:46.927345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:46.928509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-22c04f93-dfde-4ac5-9f12-3ddb2d8a5929 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159503 Mar 08 13:27:46.929111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 798/1589] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:46.975402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:46.983563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b60ad0e5-2f5a-4ac0-9917-cd9ac25c0199 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084756 Mar 08 13:27:46.984119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 792/1590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:47.076157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-924b343a-5f30-4c8a-a547-326f1eee5ceb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:47.077012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-924b343a-5f30-4c8a-a547-326f1eee5ceb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:47.083865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-924b343a-5f30-4c8a-a547-326f1eee5ceb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:47.084313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-924b343a-5f30-4c8a-a547-326f1eee5ceb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:47.085107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-924b343a-5f30-4c8a-a547-326f1eee5ceb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:47.085537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-924b343a-5f30-4c8a-a547-326f1eee5ceb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:47.124100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-924b343a-5f30-4c8a-a547-326f1eee5ceb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051748 Mar 08 13:27:47.124994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 799/1591] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:47.947880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:47.948483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:47.954730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:47.955175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:47.955931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:47.956361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:48.000472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:48.001349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:48.007650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:48.008174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:48.009168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:48.010119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:48.069919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:48.077408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-192a0e84-291d-4313-95d5-12e3deb0a0ca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081079 Mar 08 13:27:48.077966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 800/1592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:48.089124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:48.097265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:48.098738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:48.099875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-af6019cb-4213-412b-9033-32fe70130fae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.156605 Mar 08 13:27:48.100415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 793/1593] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:48.142300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3799404e-21a7-438a-89e4-69152089a72e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:48.143121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3799404e-21a7-438a-89e4-69152089a72e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:48.148996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3799404e-21a7-438a-89e4-69152089a72e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:48.149467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3799404e-21a7-438a-89e4-69152089a72e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:48.150225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3799404e-21a7-438a-89e4-69152089a72e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:48.150655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3799404e-21a7-438a-89e4-69152089a72e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:48.179118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3799404e-21a7-438a-89e4-69152089a72e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040778 Mar 08 13:27:48.179657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 801/1594] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:49.094795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:49.095410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:49.101748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:49.102203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:49.103055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:49.103520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:49.119427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:49.120039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:49.127649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:49.128186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:49.129129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:49.129659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:49.165062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:49.172980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-522f0c61-5a05-4b0a-b61f-71fac418c223 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082393 Mar 08 13:27:49.173743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 794/1595] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:49 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:49.191448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-af697be1-322e-42a7-8531-0893f1cad3a5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:49.192367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-af697be1-322e-42a7-8531-0893f1cad3a5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:49.198891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af697be1-322e-42a7-8531-0893f1cad3a5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:49.199349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af697be1-322e-42a7-8531-0893f1cad3a5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:49.200121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af697be1-322e-42a7-8531-0893f1cad3a5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:49.200559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-af697be1-322e-42a7-8531-0893f1cad3a5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:49.230212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-af697be1-322e-42a7-8531-0893f1cad3a5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042621 Mar 08 13:27:49.230791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 795/1596] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:49.274317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:49.282964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:49.284448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:49.285622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bdd27507-8121-4e59-a6c0-bfa64cad89d6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.171158 Mar 08 13:27:49.286171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 802/1597] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:27:50.189979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:50.190595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:50.196896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:50.197354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:50.198116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:50.198558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:50.241187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3032d821-cc09-4a5c-b176-573a3182d6af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:50.242102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3032d821-cc09-4a5c-b176-573a3182d6af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:50.249157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3032d821-cc09-4a5c-b176-573a3182d6af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:50.249609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3032d821-cc09-4a5c-b176-573a3182d6af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:50.250650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3032d821-cc09-4a5c-b176-573a3182d6af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:50.251089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3032d821-cc09-4a5c-b176-573a3182d6af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:50.264389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:50.271895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-50114f64-1037-4257-a23e-d687cfdaf820 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085693 Mar 08 13:27:50.272396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 796/1598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:50.281976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3032d821-cc09-4a5c-b176-573a3182d6af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Mar 08 13:27:50.282523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 803/1599] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:50.303101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:50.303708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:50.310142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:50.310592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:50.311350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:50.311782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:50.447783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:50.456164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:50.457711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:50.458865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-135a3e82-ba9c-4a85-a804-00c70ef63049 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 200 len: 1749 microversion: 2.20 time: 0.159635 Mar 08 13:27:50.459421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 797/1600] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:27:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:27:51.288223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:51.288872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:51.293659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-92fd72b4-1294-4bc7-9301-0d9e6c883679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:51.294584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-92fd72b4-1294-4bc7-9301-0d9e6c883679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:51.295329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:51.295785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:51.296550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:51.297008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:51.300908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-92fd72b4-1294-4bc7-9301-0d9e6c883679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:51.301410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-92fd72b4-1294-4bc7-9301-0d9e6c883679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:51.302202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-92fd72b4-1294-4bc7-9301-0d9e6c883679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:51.302638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-92fd72b4-1294-4bc7-9301-0d9e6c883679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:51.331429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-92fd72b4-1294-4bc7-9301-0d9e6c883679 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Mar 08 13:27:51.331987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 798/1601] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:27:51.360960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:51.368171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-18347f19-7c6f-449c-b51f-69d5ad9d277d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083771 Mar 08 13:27:51.369394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 804/1602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:52.342348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a930328d-df54-4922-9fd4-025ba5bd4080 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:52.343259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a930328d-df54-4922-9fd4-025ba5bd4080 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:52.349558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a930328d-df54-4922-9fd4-025ba5bd4080 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:52.350005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a930328d-df54-4922-9fd4-025ba5bd4080 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:52.350775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a930328d-df54-4922-9fd4-025ba5bd4080 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:52.351211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a930328d-df54-4922-9fd4-025ba5bd4080 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:52.382444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a930328d-df54-4922-9fd4-025ba5bd4080 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Mar 08 13:27:52.382990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 799/1603] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:52.385893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:52.386516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:52.392852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:52.393308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:52.394095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:52.394539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:52.452311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:52.459634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f3e31270-7a04-4dac-8638-264b9a2c085d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077899 Mar 08 13:27:52.460200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 805/1604] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:52 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:27:53.394248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4afa8456-0c36-48a9-8219-d7c9d50dd9d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:53.395206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4afa8456-0c36-48a9-8219-d7c9d50dd9d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:53.402371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4afa8456-0c36-48a9-8219-d7c9d50dd9d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:53.402813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4afa8456-0c36-48a9-8219-d7c9d50dd9d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:53.403581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4afa8456-0c36-48a9-8219-d7c9d50dd9d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:53.404021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4afa8456-0c36-48a9-8219-d7c9d50dd9d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:53.432114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4afa8456-0c36-48a9-8219-d7c9d50dd9d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 Mar 08 13:27:53.432937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 800/1605] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:53.477284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:53.477942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:53.484707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:53.485154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:53.486038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:53.486471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:53.546569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:53.553816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d7eb51fd-5759-4bf4-b537-f648baa7eac6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081120 Mar 08 13:27:53.554367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 806/1606] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:53 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:54.443482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bd0a7b46-322b-41ae-9a09-47cd5fc34487 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:54.444515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bd0a7b46-322b-41ae-9a09-47cd5fc34487 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:54.451211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd0a7b46-322b-41ae-9a09-47cd5fc34487 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:54.451649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd0a7b46-322b-41ae-9a09-47cd5fc34487 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:54.452401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd0a7b46-322b-41ae-9a09-47cd5fc34487 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:54.452931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd0a7b46-322b-41ae-9a09-47cd5fc34487 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:54.481894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bd0a7b46-322b-41ae-9a09-47cd5fc34487 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 Mar 08 13:27:54.482428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 801/1607] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:54.570646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:54.571253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:54.577870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:54.578331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:54.579097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:54.579534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:54.637549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:54.644749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d7528ff7-bf47-436f-8b81-0635ac7d9a7b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078009 Mar 08 13:27:54.645304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 807/1608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:54 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:55.494017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9b959b1e-4f16-4248-ac8e-16d78043eba2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:55.494920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9b959b1e-4f16-4248-ac8e-16d78043eba2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:55.501665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b959b1e-4f16-4248-ac8e-16d78043eba2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:55.502121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b959b1e-4f16-4248-ac8e-16d78043eba2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:55.502889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b959b1e-4f16-4248-ac8e-16d78043eba2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:55.503333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b959b1e-4f16-4248-ac8e-16d78043eba2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:55.531330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9b959b1e-4f16-4248-ac8e-16d78043eba2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 Mar 08 13:27:55.531875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 802/1609] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:55.660992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:55.661533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:55.668322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:55.668810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:55.669569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:55.670006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:55.728921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:55.736049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-726fd047-1443-48e4-a079-46c588f117b6 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079038 Mar 08 13:27:55.736603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 808/1610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:56.543255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a97bff94-6437-45f4-99bf-029594c4bbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:56.544185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a97bff94-6437-45f4-99bf-029594c4bbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:56.550620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a97bff94-6437-45f4-99bf-029594c4bbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:56.551064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a97bff94-6437-45f4-99bf-029594c4bbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:56.551861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a97bff94-6437-45f4-99bf-029594c4bbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:56.552292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a97bff94-6437-45f4-99bf-029594c4bbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:56.581095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a97bff94-6437-45f4-99bf-029594c4bbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Mar 08 13:27:56.581565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 803/1611] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:56.752767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:56.753377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:56.760554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:56.761019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:56.761784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:56.762221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:56.828164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:56.835595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d7db79d4-c343-42b8-b643-0583dddbac7c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.086953 Mar 08 13:27:56.836100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 809/1612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:56 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:57.592248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f3e18476-f31a-43de-af2e-acb2e2db6690 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:57.593181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f3e18476-f31a-43de-af2e-acb2e2db6690 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:57.599500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e18476-f31a-43de-af2e-acb2e2db6690 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:57.599888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e18476-f31a-43de-af2e-acb2e2db6690 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:57.600645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e18476-f31a-43de-af2e-acb2e2db6690 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:57.601118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f3e18476-f31a-43de-af2e-acb2e2db6690 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:57.629354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f3e18476-f31a-43de-af2e-acb2e2db6690 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041265 Mar 08 13:27:57.629880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 804/1613] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:57.852063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:57.852580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:57.859065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:57.873065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:57.873065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:57.873065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:57.919064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:57.926546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3231b647-5fe1-4dac-92ec-92fe64a66a6b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078417 Mar 08 13:27:57.927116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 810/1614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:58.640986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-484ef89a-a00f-46b0-9ffb-8eeae2fc5dfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:58.641803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-484ef89a-a00f-46b0-9ffb-8eeae2fc5dfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:58.648006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-484ef89a-a00f-46b0-9ffb-8eeae2fc5dfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:58.648450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-484ef89a-a00f-46b0-9ffb-8eeae2fc5dfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:58.649228 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-484ef89a-a00f-46b0-9ffb-8eeae2fc5dfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:58.649788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-484ef89a-a00f-46b0-9ffb-8eeae2fc5dfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:58.677522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-484ef89a-a00f-46b0-9ffb-8eeae2fc5dfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040606 Mar 08 13:27:58.678069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 805/1615] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:27:58.943203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:58.943817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:58.950287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:58.950739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:58.951507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:58.951946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:59.011603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:27:59.018904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ae76c7e9-9d01-4a38-a979-a477a640fa36 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079610 Mar 08 13:27:59.019470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 811/1616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:27:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:27:59.689371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-26616f1f-1ab7-4ef5-b67b-acb9e0279a6a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:27:59.690317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-26616f1f-1ab7-4ef5-b67b-acb9e0279a6a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:27:59.697406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26616f1f-1ab7-4ef5-b67b-acb9e0279a6a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:59.697866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26616f1f-1ab7-4ef5-b67b-acb9e0279a6a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:59.698633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26616f1f-1ab7-4ef5-b67b-acb9e0279a6a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:27:59.699069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26616f1f-1ab7-4ef5-b67b-acb9e0279a6a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:27:59.726397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-26616f1f-1ab7-4ef5-b67b-acb9e0279a6a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041025 Mar 08 13:27:59.726935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 806/1617] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:27:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:00.036011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:00.036618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:00.043708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:00.044156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:00.044939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:00.045371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:00.103359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:00.110535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bb353b76-00c8-40e2-8013-00bb66c82e0e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078569 Mar 08 13:28:00.111082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 812/1618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:00 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:00.738114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ae7c0d40-dc58-4f46-a7a1-c8e81ab1e51d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:00.739029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ae7c0d40-dc58-4f46-a7a1-c8e81ab1e51d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:00.745590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae7c0d40-dc58-4f46-a7a1-c8e81ab1e51d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:00.746044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae7c0d40-dc58-4f46-a7a1-c8e81ab1e51d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:00.746813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae7c0d40-dc58-4f46-a7a1-c8e81ab1e51d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:00.747251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae7c0d40-dc58-4f46-a7a1-c8e81ab1e51d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:00.775631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ae7c0d40-dc58-4f46-a7a1-c8e81ab1e51d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041358 Mar 08 13:28:00.776183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 807/1619] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:01.132778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:01.134518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:01.142962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:01.143409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:01.144186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:01.144617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:01.210569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:01.218000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d2a3c3f-6c06-45ec-9fd3-08e31d9807db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.092927 Mar 08 13:28:01.218559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 813/1620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:01.787192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0ad20400-5899-44bd-af9d-6515acac4eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:01.788133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0ad20400-5899-44bd-af9d-6515acac4eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:01.794980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ad20400-5899-44bd-af9d-6515acac4eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:01.795431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ad20400-5899-44bd-af9d-6515acac4eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:01.796199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ad20400-5899-44bd-af9d-6515acac4eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:01.796635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ad20400-5899-44bd-af9d-6515acac4eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:01.826772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0ad20400-5899-44bd-af9d-6515acac4eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Mar 08 13:28:01.827668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 808/1621] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:02.234344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:02.234958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:02.241257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:02.241715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:02.242485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:02.242925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:02.302416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:02.309801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b607f9a1-e09b-465c-a6db-982c32c0bbf7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079313 Mar 08 13:28:02.310360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 814/1622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:02.838606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-11ccd616-ce13-4a95-b1ae-6469a09214cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:02.839507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-11ccd616-ce13-4a95-b1ae-6469a09214cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:02.845436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ccd616-ce13-4a95-b1ae-6469a09214cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:02.845873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ccd616-ce13-4a95-b1ae-6469a09214cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:02.846702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ccd616-ce13-4a95-b1ae-6469a09214cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:02.847125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11ccd616-ce13-4a95-b1ae-6469a09214cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:02.876298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-11ccd616-ce13-4a95-b1ae-6469a09214cd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 Mar 08 13:28:02.876871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 809/1623] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:03.326881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:03.327540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:03.333752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:03.334210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:03.334996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:03.335432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:03.397142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:03.405070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-47949ff7-dc18-42f8-919a-c23bb7a035da tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082018 Mar 08 13:28:03.405618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 815/1624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:03 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:03.887946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-04b733fe-9c8a-4fca-af8e-aa0cd21ddaf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:03.888880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-04b733fe-9c8a-4fca-af8e-aa0cd21ddaf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:03.895319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04b733fe-9c8a-4fca-af8e-aa0cd21ddaf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:03.895830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04b733fe-9c8a-4fca-af8e-aa0cd21ddaf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:03.896586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04b733fe-9c8a-4fca-af8e-aa0cd21ddaf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:03.897046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04b733fe-9c8a-4fca-af8e-aa0cd21ddaf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:03.925188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-04b733fe-9c8a-4fca-af8e-aa0cd21ddaf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041310 Mar 08 13:28:03.925723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 810/1625] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:04.421598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:04.422203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:04.428545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:04.429021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:04.429770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:04.430201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:04.487851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:04.495383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5e2a1575-7670-4d18-bbfd-10a02c17d801 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077682 Mar 08 13:28:04.495940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 816/1626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:04.936784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea45b121-ffaf-4333-a1f2-7d28f39010c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:04.937689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea45b121-ffaf-4333-a1f2-7d28f39010c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:04.943870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea45b121-ffaf-4333-a1f2-7d28f39010c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:04.944312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea45b121-ffaf-4333-a1f2-7d28f39010c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:04.945104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea45b121-ffaf-4333-a1f2-7d28f39010c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:04.945531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea45b121-ffaf-4333-a1f2-7d28f39010c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:04.973838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea45b121-ffaf-4333-a1f2-7d28f39010c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Mar 08 13:28:04.974374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 811/1627] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:05.511480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:05.512086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:05.520620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:05.521451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:05.522816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:05.523590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:05.583947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:05.592048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0deb7bee-4a93-405d-bf5a-1a7a1bc9aa3c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084654 Mar 08 13:28:05.592609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 817/1628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:05.985307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ecba64d0-4a6b-446d-8623-34657ccc79c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:05.986209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ecba64d0-4a6b-446d-8623-34657ccc79c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:05.992377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecba64d0-4a6b-446d-8623-34657ccc79c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:05.992859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecba64d0-4a6b-446d-8623-34657ccc79c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:05.994555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecba64d0-4a6b-446d-8623-34657ccc79c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:05.994984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecba64d0-4a6b-446d-8623-34657ccc79c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:06.024013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ecba64d0-4a6b-446d-8623-34657ccc79c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042344 Mar 08 13:28:06.024635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 812/1629] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:06.609142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:06.609715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:06.616440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:06.616929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:06.617699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:06.618653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:06.676098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:06.683943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3d29d7b5-462e-4471-8a22-12f5b8ee31ec tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078693 Mar 08 13:28:06.684497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 818/1630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:06 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:07.035887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ef799517-5c99-4b5a-a48c-14d05ceb63b6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:07.036828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ef799517-5c99-4b5a-a48c-14d05ceb63b6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:07.043600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef799517-5c99-4b5a-a48c-14d05ceb63b6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:07.044052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef799517-5c99-4b5a-a48c-14d05ceb63b6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:07.044847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef799517-5c99-4b5a-a48c-14d05ceb63b6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:07.045285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef799517-5c99-4b5a-a48c-14d05ceb63b6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:07.073262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ef799517-5c99-4b5a-a48c-14d05ceb63b6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041364 Mar 08 13:28:07.073800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 813/1631] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:07.701113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:07.701707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:07.707936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:07.708386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:07.709180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:07.709619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:07.767900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:07.775890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e76acc0d-c443-44e2-899a-ea8bdaf93e74 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078684 Mar 08 13:28:07.776452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 819/1632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:07 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:08.085079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b7f30de6-af76-4fff-8a7f-e9bce21f562b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:08.085981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b7f30de6-af76-4fff-8a7f-e9bce21f562b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:08.092707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7f30de6-af76-4fff-8a7f-e9bce21f562b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:08.093184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7f30de6-af76-4fff-8a7f-e9bce21f562b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:08.093939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7f30de6-af76-4fff-8a7f-e9bce21f562b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:08.094369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7f30de6-af76-4fff-8a7f-e9bce21f562b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:08.124207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b7f30de6-af76-4fff-8a7f-e9bce21f562b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Mar 08 13:28:08.124925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 814/1633] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:08.792599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:08.793248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:08.799572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:08.800025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:08.800836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:08.801276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:08.859093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:08.866424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7f6cbc86-de06-4550-93f5-8aec7f5cfbe3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077840 Mar 08 13:28:08.871382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 820/1634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:08 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:09.136887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ad991f2b-d327-4ca1-9ab1-86010f764164 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:09.137718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ad991f2b-d327-4ca1-9ab1-86010f764164 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:09.143894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad991f2b-d327-4ca1-9ab1-86010f764164 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:09.144345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad991f2b-d327-4ca1-9ab1-86010f764164 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:09.145144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad991f2b-d327-4ca1-9ab1-86010f764164 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:09.145582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad991f2b-d327-4ca1-9ab1-86010f764164 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:09.173523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ad991f2b-d327-4ca1-9ab1-86010f764164 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041218 Mar 08 13:28:09.174060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 815/1635] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:09.884599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:09.885275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:09.891677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:09.899147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:09.899147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:09.899147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:09.955695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:09.963570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e7be258d-8144-4594-bda2-10bbaebd57c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083423 Mar 08 13:28:09.964133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 821/1636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:10.185814 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-431ffada-9a38-4742-a493-46f2b0243d9f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:10.186716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-431ffada-9a38-4742-a493-46f2b0243d9f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:10.193092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-431ffada-9a38-4742-a493-46f2b0243d9f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:10.193566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-431ffada-9a38-4742-a493-46f2b0243d9f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:10.194316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-431ffada-9a38-4742-a493-46f2b0243d9f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:10.194747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-431ffada-9a38-4742-a493-46f2b0243d9f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:10.222939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-431ffada-9a38-4742-a493-46f2b0243d9f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041239 Mar 08 13:28:10.223483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 816/1637] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:10.980760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:10.981421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:10.987617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:10.988054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:10.988833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:10.989265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:11.052718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:11.060425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2ee95465-b842-433a-aa8f-745017b9bc59 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084030 Mar 08 13:28:11.061023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 822/1638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:11.234603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6578c66f-478c-402a-8904-9bf303ee07e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:11.235447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6578c66f-478c-402a-8904-9bf303ee07e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:11.242594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6578c66f-478c-402a-8904-9bf303ee07e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:11.243109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6578c66f-478c-402a-8904-9bf303ee07e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:11.244101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6578c66f-478c-402a-8904-9bf303ee07e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:11.244633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6578c66f-478c-402a-8904-9bf303ee07e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:11.275998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6578c66f-478c-402a-8904-9bf303ee07e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Mar 08 13:28:11.276554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 817/1639] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:28:12.077540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:12.078136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:12.084402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:12.084885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:12.085644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:12.086078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:12.144649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:12.151941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a520b93-8a6e-42cb-b018-7b39b8b7e907 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078249 Mar 08 13:28:12.152494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 823/1640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:12.288349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b2c3fb0c-b0f5-4987-9433-b4fe2cd4ad1a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:12.289199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b2c3fb0c-b0f5-4987-9433-b4fe2cd4ad1a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:12.295996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2c3fb0c-b0f5-4987-9433-b4fe2cd4ad1a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:12.296439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2c3fb0c-b0f5-4987-9433-b4fe2cd4ad1a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:12.297232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2c3fb0c-b0f5-4987-9433-b4fe2cd4ad1a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:12.297661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b2c3fb0c-b0f5-4987-9433-b4fe2cd4ad1a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:12.325937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b2c3fb0c-b0f5-4987-9433-b4fe2cd4ad1a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041659 Mar 08 13:28:12.326486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 818/1641] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:13.168860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:13.169448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:13.175709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:13.176159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:13.176946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:13.177383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:13.235858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:13.243809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7e85b807-e07c-4680-944c-a302ff6ec97f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078145 Mar 08 13:28:13.244368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 824/1642] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:13.337738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-479fa4f3-dd72-4755-b704-402c71c4cef0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:13.338645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-479fa4f3-dd72-4755-b704-402c71c4cef0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:13.344965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-479fa4f3-dd72-4755-b704-402c71c4cef0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:13.345418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-479fa4f3-dd72-4755-b704-402c71c4cef0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:13.346192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-479fa4f3-dd72-4755-b704-402c71c4cef0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:13.346694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-479fa4f3-dd72-4755-b704-402c71c4cef0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:13.376518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-479fa4f3-dd72-4755-b704-402c71c4cef0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Mar 08 13:28:13.377096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 819/1643] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:14.260642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:14.261285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:14.267657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:14.268200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:14.269030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:14.269465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:14.329313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:14.337475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8131f17e-26c8-406d-8049-b80d72b98ca4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080186 Mar 08 13:28:14.338040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 825/1644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:14 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:14.388402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eb2ae555-18c2-4d4e-b2b9-7c07c8d14349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:14.389367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eb2ae555-18c2-4d4e-b2b9-7c07c8d14349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:14.395905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2ae555-18c2-4d4e-b2b9-7c07c8d14349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:14.396363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2ae555-18c2-4d4e-b2b9-7c07c8d14349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:14.397166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2ae555-18c2-4d4e-b2b9-7c07c8d14349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:14.397616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eb2ae555-18c2-4d4e-b2b9-7c07c8d14349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:14.433219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eb2ae555-18c2-4d4e-b2b9-7c07c8d14349 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049213 Mar 08 13:28:14.433776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 820/1645] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:15.354083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:15.354686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:15.360896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:15.361336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:15.362089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:15.362523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:15.420927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:15.428120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d4644498-8161-4347-a8b0-21a4a6afe998 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077968 Mar 08 13:28:15.428697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 826/1646] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:15 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:15.444476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2d3fe752-e07a-41ff-a192-3c2dee937309 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:15.445486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2d3fe752-e07a-41ff-a192-3c2dee937309 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:15.452733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2d3fe752-e07a-41ff-a192-3c2dee937309 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:15.453187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2d3fe752-e07a-41ff-a192-3c2dee937309 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:15.453959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2d3fe752-e07a-41ff-a192-3c2dee937309 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:15.454393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2d3fe752-e07a-41ff-a192-3c2dee937309 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:15.481870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2d3fe752-e07a-41ff-a192-3c2dee937309 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 Mar 08 13:28:15.482410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 821/1647] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:16.445457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:16.446075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:16.452387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:16.452872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:16.453637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:16.454073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:16.493606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-20adb23d-1340-4657-b9f9-b150c647b2f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:16.494625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-20adb23d-1340-4657-b9f9-b150c647b2f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:16.502597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20adb23d-1340-4657-b9f9-b150c647b2f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:16.503148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20adb23d-1340-4657-b9f9-b150c647b2f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:16.504017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20adb23d-1340-4657-b9f9-b150c647b2f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:16.504530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20adb23d-1340-4657-b9f9-b150c647b2f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:16.529913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:16.537246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-19263aa8-dbd8-4039-9992-3614a130828e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.095634 Mar 08 13:28:16.537814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 827/1648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:16.538479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-20adb23d-1340-4657-b9f9-b150c647b2f3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049094 Mar 08 13:28:16.539034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 822/1649] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:28:17.550847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2fde1363-01a3-4783-a457-c051f5926216 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:17.551758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2fde1363-01a3-4783-a457-c051f5926216 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:17.555023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:17.555600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:17.559395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fde1363-01a3-4783-a457-c051f5926216 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:17.560194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fde1363-01a3-4783-a457-c051f5926216 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:17.561561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fde1363-01a3-4783-a457-c051f5926216 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:17.561832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:17.562114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fde1363-01a3-4783-a457-c051f5926216 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:17.562280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:17.563042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:17.563470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:17.592398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2fde1363-01a3-4783-a457-c051f5926216 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Mar 08 13:28:17.595827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 828/1650] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:17.626609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:17.634476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d21e3118-25a5-4b9c-a0bb-577f20d14cd0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084141 Mar 08 13:28:17.635040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 823/1651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:17 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:18.603287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4c95c66-ff24-41f1-ba66-ecbb5edf67d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:18.604140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4c95c66-ff24-41f1-ba66-ecbb5edf67d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:18.610357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4c95c66-ff24-41f1-ba66-ecbb5edf67d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:18.610804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4c95c66-ff24-41f1-ba66-ecbb5edf67d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:18.611563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4c95c66-ff24-41f1-ba66-ecbb5edf67d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:18.611998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4c95c66-ff24-41f1-ba66-ecbb5edf67d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:18.640739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4c95c66-ff24-41f1-ba66-ecbb5edf67d0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041653 Mar 08 13:28:18.641285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 829/1652] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:28:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:28:18.650652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:18.651257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:18.657464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:18.657905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:18.658657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:18.659090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:18.716920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:18.724093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-49a9c410-83ef-4945-bb90-fe25c214b168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077208 Mar 08 13:28:18.724646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 824/1653] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:19.652014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a851089a-74d8-44d4-95a3-4a940b1e43f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:28:19.653019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a851089a-74d8-44d4-95a3-4a940b1e43f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:19.659274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a851089a-74d8-44d4-95a3-4a940b1e43f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:19.659718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a851089a-74d8-44d4-95a3-4a940b1e43f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:19.660478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a851089a-74d8-44d4-95a3-4a940b1e43f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:19.660941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a851089a-74d8-44d4-95a3-4a940b1e43f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:19.733108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a851089a-74d8-44d4-95a3-4a940b1e43f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/action" status: 200 len: 41892 microversion: 2.1 time: 0.085322 Mar 08 13:28:19.734105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 830/1654] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:28:19 2022] POST /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1/action => generated 41892 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:19.741790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:19.742429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:19.749071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:19.749521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:19.750548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:19.750979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:20.063302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:20.070565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1ad5e20b-c168-46cf-be88-72731a660320 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.333027 Mar 08 13:28:20.071714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 825/1655] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:21.089162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:21.089857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:21.098072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:21.098612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:21.099469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:21.100036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:21.162685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:21.170118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-23b55267-5f72-4f38-9a77-f80c29ec66dc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.086459 Mar 08 13:28:21.170683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 831/1656] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:22.187118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:22.187727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:22.194366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:22.194805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:22.195570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:22.197025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:22.254708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:22.262639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d0cd6e06-893d-49de-ba74-aae79f55d742 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079365 Mar 08 13:28:22.263187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 826/1657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:22 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:23.279882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:23.280490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:23.286756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:23.287206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:23.287965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:23.288403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:23.347925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:23.355402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b92591fe-0e95-4f4d-918c-1c34c5c7a5cd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079442 Mar 08 13:28:23.355957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 832/1658] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:23 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:24.371584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:24.372193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:24.378737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:24.379180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:24.379931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:24.380360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:24.438480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:24.445921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dc60f9f6-71d5-49d7-b292-b58b352a11af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078725 Mar 08 13:28:24.446910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 827/1659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:25.462746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:25.463348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:25.469594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:25.470041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:25.470797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:25.471228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:25.535056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:25.543744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d4b74929-9cc9-46c5-adf2-b8ec46f797db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085429 Mar 08 13:28:25.544317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 833/1660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:26.559406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:26.560015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:26.566380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:26.566827 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:26.567595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:26.568081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:26.630028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:26.637897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ec73f323-3119-45ec-bfe4-c287a7f8c917 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082484 Mar 08 13:28:26.638478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 828/1661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:27.655148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:27.655722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:27.662029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:27.662482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:27.663241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:27.663681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:27.721493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:27.729222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ef530d3b-058a-4710-8ccf-ea269c1ce947 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078100 Mar 08 13:28:27.729782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 834/1662] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:27 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:28.745797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:28.746405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:28.753023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:28.753478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:28.754237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:28.754674 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:28.816149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:28.824401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-06c4b81b-61c7-4257-a3ab-3fbc0275e323 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082543 Mar 08 13:28:28.825004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 829/1663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:29.842291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:29.842883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:29.849180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:29.849628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:29.850394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:29.850828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:29.911107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:29.919788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-df083f76-612f-4ac3-87ee-718d0379d4b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081347 Mar 08 13:28:29.920355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 835/1664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:29 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:30.937182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:30.937831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:30.945242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:30.945828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:30.946710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:30.947144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:31.011954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:31.019914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fab3b7fc-53e5-466a-b1d6-bbbb65dbe9a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.086598 Mar 08 13:28:31.020486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 830/1665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:32.038179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:32.038794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:32.045251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:32.045695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:32.046464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:32.046897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:32.109221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:32.116498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1581b236-5542-44d5-869e-99a21958d350 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082168 Mar 08 13:28:32.117080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 836/1666] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:32 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:32.579485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:32.580605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:32.587257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:32.588048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:32.589075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:32.589509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:32.707753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:32.708501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:32.715253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:32.716360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:32.717226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:32.717734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:39.663557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid 3bb7cf51-102c-4301-941a-338b211f4ddb {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:28:40.185955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Cannot 'detach_volume' instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 while it is in task_state spawning Mar 08 13:28:40.186456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 409 to user: Cannot 'detach_volume' instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 while it is in task_state spawning {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:28:40.187287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aa8c54e6-563e-4f7d-a5c1-05976f7e6263 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments/de97e165-7a16-43c7-84fb-bd3abbacc68d" status: 409 len: 155 microversion: 2.20 time: 7.483779 Mar 08 13:28:40.187836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 837/1667] 10.222.0.52 () {60 vars in 1456 bytes} [Tue Mar 8 13:28:32 2022] DELETE /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments/de97e165-7a16-43c7-84fb-bd3abbacc68d => generated 155 bytes in 7485 msecs (HTTP/1.1 409) 9 headers in 380 bytes (2 switches on core 0) Mar 08 13:28:40.196980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:40.204037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:40.204037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:40.204037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:40.205790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:40.206235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:40.270473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:40.279146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-932174d5-dbe3-4fb1-80d7-a5c3041e789b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085426 Mar 08 13:28:40.279840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 838/1668] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:40 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:40.292296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-19f3e292-ac13-4b2c-ba6c-d3d655e2bf92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:40.292296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-19f3e292-ac13-4b2c-ba6c-d3d655e2bf92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:40.292296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f3e292-ac13-4b2c-ba6c-d3d655e2bf92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:40.292296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f3e292-ac13-4b2c-ba6c-d3d655e2bf92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:40.293058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f3e292-ac13-4b2c-ba6c-d3d655e2bf92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:40.293500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-19f3e292-ac13-4b2c-ba6c-d3d655e2bf92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:40.323827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-19f3e292-ac13-4b2c-ba6c-d3d655e2bf92 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042789 Mar 08 13:28:40.324377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 839/1669] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:41.299206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:41.299884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:41.306163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:41.306608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:41.307361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:41.307792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:41.371624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:41.379272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7ae58644-f682-4c6a-a085-5779930a9968 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083925 Mar 08 13:28:41.379838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 840/1670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:41.384953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e4932d2a-cc74-4377-933f-a3a3bc47ad28 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:41.385844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e4932d2a-cc74-4377-933f-a3a3bc47ad28 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:41.391268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4932d2a-cc74-4377-933f-a3a3bc47ad28 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:41.391718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4932d2a-cc74-4377-933f-a3a3bc47ad28 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:41.392474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4932d2a-cc74-4377-933f-a3a3bc47ad28 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:41.392945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4932d2a-cc74-4377-933f-a3a3bc47ad28 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:41.421464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e4932d2a-cc74-4377-933f-a3a3bc47ad28 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040656 Mar 08 13:28:41.422007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 841/1671] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:42.396386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:42.397123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:42.403719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:42.404164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:42.404987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:42.405420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:42.464118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:42.471622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-079c6ec6-1ff2-4ece-838d-eb02d3003d62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079103 Mar 08 13:28:42.472169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 842/1672] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:42.477406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d70dcc03-4577-412f-93ad-6a40c95d0c1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:42.478293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d70dcc03-4577-412f-93ad-6a40c95d0c1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:42.483982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70dcc03-4577-412f-93ad-6a40c95d0c1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:42.484439 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70dcc03-4577-412f-93ad-6a40c95d0c1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:42.485239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70dcc03-4577-412f-93ad-6a40c95d0c1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:42.485710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70dcc03-4577-412f-93ad-6a40c95d0c1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:42.513462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d70dcc03-4577-412f-93ad-6a40c95d0c1d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040303 Mar 08 13:28:42.514005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 843/1673] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:43.488907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:43.489604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:43.496812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:43.497266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:43.498028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:43.498463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:43.557887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:43.565111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-502964ee-4911-4067-87d6-a9263032986a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080065 Mar 08 13:28:43.565668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 844/1674] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:43 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:43.570245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f743bc85-feb6-4ae7-87b7-8bcfa880d1c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:43.571135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f743bc85-feb6-4ae7-87b7-8bcfa880d1c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:43.576906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f743bc85-feb6-4ae7-87b7-8bcfa880d1c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:43.577362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f743bc85-feb6-4ae7-87b7-8bcfa880d1c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:43.578133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f743bc85-feb6-4ae7-87b7-8bcfa880d1c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:43.578570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f743bc85-feb6-4ae7-87b7-8bcfa880d1c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:43.614054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f743bc85-feb6-4ae7-87b7-8bcfa880d1c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047236 Mar 08 13:28:43.614524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 845/1675] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:44.581795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:44.582448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:44.589004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:44.589447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:44.590210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:44.590649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:44.649602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:44.656928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b994b909-39fa-45fb-94ae-2c3e31c7668d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078943 Mar 08 13:28:44.657483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 846/1676] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:44 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:44.662188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4b82cf03-eaad-46db-98b4-f6c6ba780fe0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:44.663073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4b82cf03-eaad-46db-98b4-f6c6ba780fe0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:44.669222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b82cf03-eaad-46db-98b4-f6c6ba780fe0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:44.669667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b82cf03-eaad-46db-98b4-f6c6ba780fe0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:44.670424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b82cf03-eaad-46db-98b4-f6c6ba780fe0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:44.670859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b82cf03-eaad-46db-98b4-f6c6ba780fe0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:44.698593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4b82cf03-eaad-46db-98b4-f6c6ba780fe0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040137 Mar 08 13:28:44.699136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 847/1677] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:45.674760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:45.675367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:45.682384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:45.682827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:45.683585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:45.684020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:45.741402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:45.749023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1b9ef165-84d5-4cbe-a3ac-797db202b0d2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078234 Mar 08 13:28:45.749577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 848/1678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:45 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:45.754260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1ccf2660-3383-475a-ae84-f152d9933c3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:45.755142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1ccf2660-3383-475a-ae84-f152d9933c3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:45.761418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ccf2660-3383-475a-ae84-f152d9933c3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:45.761611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ccf2660-3383-475a-ae84-f152d9933c3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:45.763215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ccf2660-3383-475a-ae84-f152d9933c3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:45.763215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1ccf2660-3383-475a-ae84-f152d9933c3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:45.798711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1ccf2660-3383-475a-ae84-f152d9933c3f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047884 Mar 08 13:28:45.799255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 849/1679] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:46.766724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:46.767350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:46.773554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:46.774002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:46.774755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:46.775188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:46.832793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:46.840002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b27cfc7b-6676-40a8-9be0-4017abec9382 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077115 Mar 08 13:28:46.840555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 850/1680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:46.845129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dc9aeaf5-8376-4287-8ea3-f4cc10e17e14 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:46.846011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dc9aeaf5-8376-4287-8ea3-f4cc10e17e14 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:46.852173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9aeaf5-8376-4287-8ea3-f4cc10e17e14 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:46.852620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9aeaf5-8376-4287-8ea3-f4cc10e17e14 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:46.853402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9aeaf5-8376-4287-8ea3-f4cc10e17e14 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:46.853835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dc9aeaf5-8376-4287-8ea3-f4cc10e17e14 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:46.882377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dc9aeaf5-8376-4287-8ea3-f4cc10e17e14 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040714 Mar 08 13:28:46.882998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 851/1681] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:47.855979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:47.856591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:47.862932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:47.863386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:47.864148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:47.869771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:47.927031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:47.934900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9901ea74-d55d-4bb7-88eb-87700d621c49 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082991 Mar 08 13:28:47.935457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 852/1682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:47.940005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ed29b723-ca94-4a4f-bbac-710d621941f0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:47.940936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ed29b723-ca94-4a4f-bbac-710d621941f0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:47.947265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed29b723-ca94-4a4f-bbac-710d621941f0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:47.947705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed29b723-ca94-4a4f-bbac-710d621941f0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:47.948459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed29b723-ca94-4a4f-bbac-710d621941f0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:47.948922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed29b723-ca94-4a4f-bbac-710d621941f0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:47.980921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ed29b723-ca94-4a4f-bbac-710d621941f0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044333 Mar 08 13:28:47.981486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 853/1683] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:48.952935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:48.953618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:48.959879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:48.960326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:48.961723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:48.962343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:49.032786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:49.040279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0fdf9c24-e70b-4d06-bdf0-f0308ddfb1db tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.092057 Mar 08 13:28:49.040867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 854/1684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:48 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:49.045479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-49d68c8a-43a2-4dd2-8e1e-f8c0bf944174 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:49.046361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-49d68c8a-43a2-4dd2-8e1e-f8c0bf944174 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:49.051748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49d68c8a-43a2-4dd2-8e1e-f8c0bf944174 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:49.052198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49d68c8a-43a2-4dd2-8e1e-f8c0bf944174 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:49.052987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49d68c8a-43a2-4dd2-8e1e-f8c0bf944174 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:49.053425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-49d68c8a-43a2-4dd2-8e1e-f8c0bf944174 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:49.082483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-49d68c8a-43a2-4dd2-8e1e-f8c0bf944174 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040592 Mar 08 13:28:49.083554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 855/1685] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:50.057321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:50.057929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:50.064438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:50.064920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:50.065689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:50.066123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:50.127165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:50.135109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-da861d90-cce8-483c-aa5f-80d3701d33b1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082211 Mar 08 13:28:50.135667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 856/1686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:50.140178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1a101ea3-2070-4d4b-9b24-b1068ce8ce03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:50.141091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1a101ea3-2070-4d4b-9b24-b1068ce8ce03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:50.146590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a101ea3-2070-4d4b-9b24-b1068ce8ce03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:50.147038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a101ea3-2070-4d4b-9b24-b1068ce8ce03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:50.147809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a101ea3-2070-4d4b-9b24-b1068ce8ce03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:50.148883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a101ea3-2070-4d4b-9b24-b1068ce8ce03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:50.177801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1a101ea3-2070-4d4b-9b24-b1068ce8ce03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041136 Mar 08 13:28:50.178342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 857/1687] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:51.151746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:51.152396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:51.158600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:51.159083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:51.159867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:51.160298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:51.371672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:51.379295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-09359668-7a69-45ab-a7ef-40a568aad2f1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.231590 Mar 08 13:28:51.379847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 858/1688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:28:51.384414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-51b5938e-024e-4f67-a75b-69d31b603454 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:51.385325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-51b5938e-024e-4f67-a75b-69d31b603454 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:51.392264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51b5938e-024e-4f67-a75b-69d31b603454 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:51.393129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51b5938e-024e-4f67-a75b-69d31b603454 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:51.394505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51b5938e-024e-4f67-a75b-69d31b603454 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:51.395289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51b5938e-024e-4f67-a75b-69d31b603454 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:51.427955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-51b5938e-024e-4f67-a75b-69d31b603454 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047073 Mar 08 13:28:51.428513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 859/1689] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:52.396228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:52.396887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:52.403071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:52.403516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:52.404268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:52.404728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:52.480129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:52.480129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c1a25e0e-1216-4d07-b540-87d00516d96e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080080 Mar 08 13:28:52.480129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 860/1690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:52 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:52.480129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2c3c8db6-6791-4a7d-9bca-5b928c25376b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:52.480600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2c3c8db6-6791-4a7d-9bca-5b928c25376b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:52.484442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c3c8db6-6791-4a7d-9bca-5b928c25376b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:52.484927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c3c8db6-6791-4a7d-9bca-5b928c25376b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:52.485696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c3c8db6-6791-4a7d-9bca-5b928c25376b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:52.486134 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c3c8db6-6791-4a7d-9bca-5b928c25376b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:52.515745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2c3c8db6-6791-4a7d-9bca-5b928c25376b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041723 Mar 08 13:28:52.516285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 861/1691] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:53.488595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:53.489342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:53.496276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:53.496764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:53.497567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:53.498005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:53.559255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:53.566788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-37767924-a0f3-43b4-8398-f4c11c1894d0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082106 Mar 08 13:28:53.567347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 862/1692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:53 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:53.572306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7845af06-a019-4247-9fb4-37eb940848f5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:53.573238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7845af06-a019-4247-9fb4-37eb940848f5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:53.578941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7845af06-a019-4247-9fb4-37eb940848f5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:53.579389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7845af06-a019-4247-9fb4-37eb940848f5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:53.580144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7845af06-a019-4247-9fb4-37eb940848f5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:53.580573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7845af06-a019-4247-9fb4-37eb940848f5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:53.611130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7845af06-a019-4247-9fb4-37eb940848f5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042693 Mar 08 13:28:53.611580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 863/1693] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:54.583135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:54.583780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:54.590348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:54.590791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:54.591545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:54.591977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:54.654593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:54.661925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-25623c8e-1e69-4a51-bfa8-2e497d7201c1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082620 Mar 08 13:28:54.662478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 864/1694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:54 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:54.667521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-80a5f34b-2150-42d5-85d5-3a2069ceda87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:54.668398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-80a5f34b-2150-42d5-85d5-3a2069ceda87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:54.673752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80a5f34b-2150-42d5-85d5-3a2069ceda87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:54.674193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80a5f34b-2150-42d5-85d5-3a2069ceda87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:54.674973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80a5f34b-2150-42d5-85d5-3a2069ceda87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:54.675413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80a5f34b-2150-42d5-85d5-3a2069ceda87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:54.704410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-80a5f34b-2150-42d5-85d5-3a2069ceda87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040953 Mar 08 13:28:54.704983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 865/1695] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:55.678427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:55.679073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:55.685431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:55.685870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:55.686628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:55.687060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:55.745578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:55.752970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5eb639e6-5282-4085-b0e9-655af2051d6c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078371 Mar 08 13:28:55.753525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 866/1696] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:55.758559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0383749b-e71e-4279-9565-07e81be5a623 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:55.759443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0383749b-e71e-4279-9565-07e81be5a623 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:55.765083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0383749b-e71e-4279-9565-07e81be5a623 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:55.765535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0383749b-e71e-4279-9565-07e81be5a623 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:55.766363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0383749b-e71e-4279-9565-07e81be5a623 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:55.766802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0383749b-e71e-4279-9565-07e81be5a623 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:55.795145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0383749b-e71e-4279-9565-07e81be5a623 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040644 Mar 08 13:28:55.795685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 867/1697] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:56.770444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:56.771105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:56.777919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:56.778366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:56.779134 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:56.779571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:56.838334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:56.845641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4ace58cb-e294-4401-b67a-4bf93b05cd9b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079112 Mar 08 13:28:56.846203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 868/1698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:56 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:56.850697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2220110e-6565-4588-9da5-e9eb142a0d03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:56.852341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2220110e-6565-4588-9da5-e9eb142a0d03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:56.858162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2220110e-6565-4588-9da5-e9eb142a0d03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:56.858618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2220110e-6565-4588-9da5-e9eb142a0d03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:56.859389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2220110e-6565-4588-9da5-e9eb142a0d03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:56.859826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2220110e-6565-4588-9da5-e9eb142a0d03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:56.889523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2220110e-6565-4588-9da5-e9eb142a0d03 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042291 Mar 08 13:28:56.890071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 869/1699] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:57.862725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:57.863427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:57.870223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:57.872520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:57.872520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:57.872520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:57.933306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:57.940407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ff1d6814-20ac-40b9-bd4d-d44d8f3bd27b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081545 Mar 08 13:28:57.941010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 870/1700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:57.945635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-871964e1-14ce-4e59-9770-781eac3e78b9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:57.946521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-871964e1-14ce-4e59-9770-781eac3e78b9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:57.952056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-871964e1-14ce-4e59-9770-781eac3e78b9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:57.952503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-871964e1-14ce-4e59-9770-781eac3e78b9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:57.953301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-871964e1-14ce-4e59-9770-781eac3e78b9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:57.953735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-871964e1-14ce-4e59-9770-781eac3e78b9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:57.981886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-871964e1-14ce-4e59-9770-781eac3e78b9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039886 Mar 08 13:28:57.982428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 871/1701] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:28:58.957019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:58.957680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:58.964468 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:58.964951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:58.965715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:58.966151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:59.027587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:28:59.034853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-de4846f3-1e5e-45f2-be26-2d9bf1a7ce62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081773 Mar 08 13:28:59.035410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 872/1702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:28:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:28:59.040526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f6770af6-8eaa-41be-8d65-758e0efaf888 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:28:59.042341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f6770af6-8eaa-41be-8d65-758e0efaf888 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:28:59.048128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6770af6-8eaa-41be-8d65-758e0efaf888 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:59.048580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6770af6-8eaa-41be-8d65-758e0efaf888 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:59.049381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6770af6-8eaa-41be-8d65-758e0efaf888 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:28:59.049822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f6770af6-8eaa-41be-8d65-758e0efaf888 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:28:59.077342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f6770af6-8eaa-41be-8d65-758e0efaf888 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040944 Mar 08 13:28:59.077883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 873/1703] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:28:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:00.051938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:00.052420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:00.058798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:00.059252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:00.060026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:00.060469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:00.119959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:00.127664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6e67a771-e2d5-46ef-8926-1fa56291247d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079700 Mar 08 13:29:00.128228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 874/1704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:00 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:00.133347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a72153d3-bd2b-4d83-9d64-08922f42e4e4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:00.134424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a72153d3-bd2b-4d83-9d64-08922f42e4e4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:00.139949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a72153d3-bd2b-4d83-9d64-08922f42e4e4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:00.140401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a72153d3-bd2b-4d83-9d64-08922f42e4e4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:00.141201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a72153d3-bd2b-4d83-9d64-08922f42e4e4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:00.141646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a72153d3-bd2b-4d83-9d64-08922f42e4e4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:00.171697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a72153d3-bd2b-4d83-9d64-08922f42e4e4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042423 Mar 08 13:29:00.172252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 875/1705] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:00 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:01.145200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:01.145911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:01.152808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:01.153350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:01.154117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:01.154548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:01.217165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:01.224470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6cea26c0-8bc9-4fa3-9e3f-f26d02d5b8f2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083163 Mar 08 13:29:01.225074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 876/1706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:01.230438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dcd57e48-db5a-44bb-aedd-355ffeb2f7c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:01.231333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dcd57e48-db5a-44bb-aedd-355ffeb2f7c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:01.236701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcd57e48-db5a-44bb-aedd-355ffeb2f7c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:01.237160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcd57e48-db5a-44bb-aedd-355ffeb2f7c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:01.237931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcd57e48-db5a-44bb-aedd-355ffeb2f7c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:01.238369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dcd57e48-db5a-44bb-aedd-355ffeb2f7c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:01.265787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dcd57e48-db5a-44bb-aedd-355ffeb2f7c9 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039744 Mar 08 13:29:01.266327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 877/1707] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:02.241719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:02.242354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:02.248479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:02.248984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:02.250006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:02.250439 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:02.309955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:02.317355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-93dbf2e2-75bf-408a-921f-186d362714f0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079459 Mar 08 13:29:02.317922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 878/1708] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:02.323186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c9cbab5b-f629-4775-a6b8-f091f89f4299 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:02.324120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c9cbab5b-f629-4775-a6b8-f091f89f4299 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:02.329883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9cbab5b-f629-4775-a6b8-f091f89f4299 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:02.330335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9cbab5b-f629-4775-a6b8-f091f89f4299 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:02.331131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9cbab5b-f629-4775-a6b8-f091f89f4299 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:02.331569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9cbab5b-f629-4775-a6b8-f091f89f4299 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:02.360209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c9cbab5b-f629-4775-a6b8-f091f89f4299 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041279 Mar 08 13:29:02.360776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 879/1709] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:02.669560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:29:02.669786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:29:03.333908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:03.334577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:03.340941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:03.341389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:03.342151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:03.342614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:03.411177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:03.420151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5ac72e2d-8371-4d6a-a71c-a78fcce7c601 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.090096 Mar 08 13:29:03.420727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 880/1710] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:03 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:03.425250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3f14989c-1a58-4c9f-87ca-f2f4d1fff9ae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:03.426209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3f14989c-1a58-4c9f-87ca-f2f4d1fff9ae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:03.432076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f14989c-1a58-4c9f-87ca-f2f4d1fff9ae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:03.432532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f14989c-1a58-4c9f-87ca-f2f4d1fff9ae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:03.433326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f14989c-1a58-4c9f-87ca-f2f4d1fff9ae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:03.433767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f14989c-1a58-4c9f-87ca-f2f4d1fff9ae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:03.463542 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3f14989c-1a58-4c9f-87ca-f2f4d1fff9ae tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041782 Mar 08 13:29:03.464096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 881/1711] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:04.437348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:04.438147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:04.444336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:04.444854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:04.445644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:04.446123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:04.505482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:04.513009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1696648e-4f31-4787-bca8-eb00e639a13c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079676 Mar 08 13:29:04.513568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 882/1712] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:04.648251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9fa65d6e-2a20-459a-9d98-f225644ed625 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:04.649477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9fa65d6e-2a20-459a-9d98-f225644ed625 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:04.655324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa65d6e-2a20-459a-9d98-f225644ed625 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:04.655770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa65d6e-2a20-459a-9d98-f225644ed625 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:04.656525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa65d6e-2a20-459a-9d98-f225644ed625 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:04.656980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9fa65d6e-2a20-459a-9d98-f225644ed625 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:04.686679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9fa65d6e-2a20-459a-9d98-f225644ed625 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.172071 Mar 08 13:29:04.687236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 883/1713] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:05.529532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:05.530216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:05.536302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:05.536778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:05.537535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:05.537967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:05.596455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:05.604614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f9cbef46-f5f0-484f-ac82-c22dbe367362 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078908 Mar 08 13:29:05.605139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 884/1714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:05.698116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b6df8d9-0f92-466d-bc9c-15b4be7c813b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:05.699152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1b6df8d9-0f92-466d-bc9c-15b4be7c813b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:05.705003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b6df8d9-0f92-466d-bc9c-15b4be7c813b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:05.705452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b6df8d9-0f92-466d-bc9c-15b4be7c813b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:05.706215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b6df8d9-0f92-466d-bc9c-15b4be7c813b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:05.706642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b6df8d9-0f92-466d-bc9c-15b4be7c813b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:05.734812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1b6df8d9-0f92-466d-bc9c-15b4be7c813b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040574 Mar 08 13:29:05.735350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 885/1715] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:29:06.621842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:06.622539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:06.628918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:06.629373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:06.630197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:06.630679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:06.690136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:06.698199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-55264473-0e43-47b3-b572-c3952704aaca tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080320 Mar 08 13:29:06.698769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 886/1716] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:06 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:06.746890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-97ed157b-6998-4530-a52b-a7b6314b0f71 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:06.747796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-97ed157b-6998-4530-a52b-a7b6314b0f71 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:06.753909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ed157b-6998-4530-a52b-a7b6314b0f71 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:06.754365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ed157b-6998-4530-a52b-a7b6314b0f71 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:06.755133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ed157b-6998-4530-a52b-a7b6314b0f71 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:06.755575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97ed157b-6998-4530-a52b-a7b6314b0f71 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:06.784228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-97ed157b-6998-4530-a52b-a7b6314b0f71 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041227 Mar 08 13:29:06.784792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 887/1717] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:29:07.715302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:07.716081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:07.722167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:07.722609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:07.723365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:07.723798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:07.786466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:07.793880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ffe7e4a0-a439-47ee-9514-4882a980738b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082432 Mar 08 13:29:07.794436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 888/1718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:07 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:07.798928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0a22f0e5-a40c-479e-9bdf-da4106a83891 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:07.799839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0a22f0e5-a40c-479e-9bdf-da4106a83891 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:07.805607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a22f0e5-a40c-479e-9bdf-da4106a83891 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:07.806063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a22f0e5-a40c-479e-9bdf-da4106a83891 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:07.806869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a22f0e5-a40c-479e-9bdf-da4106a83891 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:07.807311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a22f0e5-a40c-479e-9bdf-da4106a83891 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:07.836130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0a22f0e5-a40c-479e-9bdf-da4106a83891 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040026 Mar 08 13:29:07.836691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 889/1719] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:07 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:08.811090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:08.811774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:08.817975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:08.818434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:08.819195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:08.820411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:08.879287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:08.887307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5446ed84-f4c8-406f-b480-8b74d42f6d58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080235 Mar 08 13:29:08.887871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 890/1720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:08 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:08.892376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-db1e6d42-9604-4453-abea-c5feb09dd363 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:08.893305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-db1e6d42-9604-4453-abea-c5feb09dd363 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:08.899318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db1e6d42-9604-4453-abea-c5feb09dd363 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:08.899777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db1e6d42-9604-4453-abea-c5feb09dd363 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:08.900558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db1e6d42-9604-4453-abea-c5feb09dd363 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:08.901037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db1e6d42-9604-4453-abea-c5feb09dd363 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:08.928774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-db1e6d42-9604-4453-abea-c5feb09dd363 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039889 Mar 08 13:29:08.930155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 891/1721] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:09.903933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:09.904605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:09.910888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:09.911333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:09.912118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:09.912549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:09.971965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:09.980018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-50eb3f4c-5820-44f9-a6b0-6ffc898eea45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079957 Mar 08 13:29:09.980578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 892/1722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:09.985083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-33254b70-f434-4ee3-9ab6-1282735eb8db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:09.985975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-33254b70-f434-4ee3-9ab6-1282735eb8db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:09.991335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33254b70-f434-4ee3-9ab6-1282735eb8db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:09.992536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33254b70-f434-4ee3-9ab6-1282735eb8db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:09.993384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33254b70-f434-4ee3-9ab6-1282735eb8db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:09.993822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33254b70-f434-4ee3-9ab6-1282735eb8db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:10.021539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-33254b70-f434-4ee3-9ab6-1282735eb8db tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039953 Mar 08 13:29:10.022084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 893/1723] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:10.996359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:10.997068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:11.003516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:11.003968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:11.004769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:11.005207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:11.064426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:11.072198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5b261628-6ea7-4fb3-b95b-f65c02c575bb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079737 Mar 08 13:29:11.072780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 894/1724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:11.077245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f46e6497-9e79-444b-b251-f178bb77c01b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:11.078131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f46e6497-9e79-444b-b251-f178bb77c01b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:11.083462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f46e6497-9e79-444b-b251-f178bb77c01b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:11.083909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f46e6497-9e79-444b-b251-f178bb77c01b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:11.084679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f46e6497-9e79-444b-b251-f178bb77c01b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:11.085164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f46e6497-9e79-444b-b251-f178bb77c01b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:11.112532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f46e6497-9e79-444b-b251-f178bb77c01b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038787 Mar 08 13:29:11.113097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 895/1725] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:11.976682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:29:11.977285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:29:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:29:12.087760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:12.088367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:12.094641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:12.095087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:12.095841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:12.096272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:12.157505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:12.165233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1738e91f-882e-4da0-98dc-c67168a791ef tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081411 Mar 08 13:29:12.165785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 896/1726] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:12.170221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-777c72d0-95a1-4d66-ab71-762f2a913fe4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:12.171101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-777c72d0-95a1-4d66-ab71-762f2a913fe4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:12.176352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-777c72d0-95a1-4d66-ab71-762f2a913fe4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:12.176843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-777c72d0-95a1-4d66-ab71-762f2a913fe4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:12.177596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-777c72d0-95a1-4d66-ab71-762f2a913fe4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:12.178026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-777c72d0-95a1-4d66-ab71-762f2a913fe4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:12.205546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-777c72d0-95a1-4d66-ab71-762f2a913fe4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038794 Mar 08 13:29:12.206080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 897/1727] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:13.181720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:13.182445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:13.188744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:13.189197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:13.189960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:13.190398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:13.252781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:13.260088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-af492d6f-c5d5-414f-a1f0-f4fafee675f5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082237 Mar 08 13:29:13.260617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 898/1728] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:13.265062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2c1bfe4d-e21c-4856-a382-adaadf3bcb8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:13.265946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2c1bfe4d-e21c-4856-a382-adaadf3bcb8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:13.271219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1bfe4d-e21c-4856-a382-adaadf3bcb8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:13.271664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1bfe4d-e21c-4856-a382-adaadf3bcb8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:13.272411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1bfe4d-e21c-4856-a382-adaadf3bcb8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:13.272874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c1bfe4d-e21c-4856-a382-adaadf3bcb8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:13.309807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2c1bfe4d-e21c-4856-a382-adaadf3bcb8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048134 Mar 08 13:29:13.310412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 899/1729] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:14.277367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:14.278081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:14.284205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:14.284651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:14.285434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:14.285865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:14.348698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:14.356180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eaa9b4e2-8f12-40ba-af3d-70289a3e7aee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083438 Mar 08 13:29:14.356759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 900/1730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:14 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:14.361305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f999bac-f0ce-4023-b690-f3c561ad5c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:14.362195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f999bac-f0ce-4023-b690-f3c561ad5c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:14.367772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f999bac-f0ce-4023-b690-f3c561ad5c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:14.368222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f999bac-f0ce-4023-b690-f3c561ad5c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:14.369045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f999bac-f0ce-4023-b690-f3c561ad5c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:14.369593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f999bac-f0ce-4023-b690-f3c561ad5c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:14.404335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f999bac-f0ce-4023-b690-f3c561ad5c13 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046522 Mar 08 13:29:14.404913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 901/1731] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:14 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:15.373028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:15.373645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:15.379816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:15.380260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:15.381077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:15.381512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:15.440741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:15.450570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8464c42b-a9e8-4dcf-82dd-531aceaf875e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081353 Mar 08 13:29:15.451374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 902/1732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:15 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:15.457411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-64a9e603-90f4-4cfa-b1e7-885c83e7cea5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:15.458488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-64a9e603-90f4-4cfa-b1e7-885c83e7cea5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:15.465791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64a9e603-90f4-4cfa-b1e7-885c83e7cea5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:15.466295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64a9e603-90f4-4cfa-b1e7-885c83e7cea5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:15.467363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64a9e603-90f4-4cfa-b1e7-885c83e7cea5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:15.467909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64a9e603-90f4-4cfa-b1e7-885c83e7cea5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:15.499086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-64a9e603-90f4-4cfa-b1e7-885c83e7cea5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046558 Mar 08 13:29:15.499884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 903/1733] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:16.467498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:16.468116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:16.474391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:16.474836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:16.475588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:16.476018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:16.534655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:16.542437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee4e58ab-201b-4cca-a840-620065d4b620 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078771 Mar 08 13:29:16.542986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 904/1734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:16.547419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eaf4553e-7df8-414d-97c5-f53685764799 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:16.548300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eaf4553e-7df8-414d-97c5-f53685764799 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:16.553631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaf4553e-7df8-414d-97c5-f53685764799 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:16.554074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaf4553e-7df8-414d-97c5-f53685764799 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:16.555734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaf4553e-7df8-414d-97c5-f53685764799 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:16.556177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eaf4553e-7df8-414d-97c5-f53685764799 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:16.583352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eaf4553e-7df8-414d-97c5-f53685764799 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039408 Mar 08 13:29:16.583890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 905/1735] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:17.559832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:17.560503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:17.566683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:17.567125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:17.567874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:17.568304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:17.626876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:17.634064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ab3f51e5-873f-46d2-84d3-f88b4dbb06b9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078111 Mar 08 13:29:17.634646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 906/1736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:17 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:17.639267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-061508f9-d982-4a78-8e30-cb8d4bc91e5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:17.640148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-061508f9-d982-4a78-8e30-cb8d4bc91e5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:17.645500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-061508f9-d982-4a78-8e30-cb8d4bc91e5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:17.645945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-061508f9-d982-4a78-8e30-cb8d4bc91e5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:17.646735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-061508f9-d982-4a78-8e30-cb8d4bc91e5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:17.647169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-061508f9-d982-4a78-8e30-cb8d4bc91e5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:17.675428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-061508f9-d982-4a78-8e30-cb8d4bc91e5c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039817 Mar 08 13:29:17.675957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 907/1737] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:18.650886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:18.651545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:18.657863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:18.658309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:18.659069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:18.659507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:18.719630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:18.727232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a3a2427-4599-4118-9052-334e89eab6d4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080450 Mar 08 13:29:18.727794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 908/1738] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:18.732379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6d433da7-d900-453c-8bd8-b8ae19d409d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:18.733401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6d433da7-d900-453c-8bd8-b8ae19d409d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:18.743182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d433da7-d900-453c-8bd8-b8ae19d409d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:18.743635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d433da7-d900-453c-8bd8-b8ae19d409d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:18.744454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d433da7-d900-453c-8bd8-b8ae19d409d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:18.744932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d433da7-d900-453c-8bd8-b8ae19d409d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:18.779603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6d433da7-d900-453c-8bd8-b8ae19d409d8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050669 Mar 08 13:29:18.781173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 909/1739] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:19.744056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:19.744764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:19.753551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:19.754000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:19.754772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:19.755204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:19.820488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:19.827924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-24d339f4-7d34-4fbf-9054-d2ebf61de5c7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.088326 Mar 08 13:29:19.828485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 910/1740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:19.833098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-87447451-2d7b-446d-8667-0cf27faaddf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:19.833969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-87447451-2d7b-446d-8667-0cf27faaddf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:19.840006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87447451-2d7b-446d-8667-0cf27faaddf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:19.840454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87447451-2d7b-446d-8667-0cf27faaddf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:19.841256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87447451-2d7b-446d-8667-0cf27faaddf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:19.841692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87447451-2d7b-446d-8667-0cf27faaddf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:19.871914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-87447451-2d7b-446d-8667-0cf27faaddf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042409 Mar 08 13:29:19.872455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 911/1741] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:20.845038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:20.845702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:20.852539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:20.853014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:20.853774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:20.854207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:20.914675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:20.923219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a67033a-1a6c-4eda-b0df-a5495bf1755e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082028 Mar 08 13:29:20.923778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 912/1742] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:20 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:20.928490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aed82e09-2b59-44d0-ba79-eb82bead21f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:20.929461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aed82e09-2b59-44d0-ba79-eb82bead21f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:20.935083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed82e09-2b59-44d0-ba79-eb82bead21f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:20.935534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed82e09-2b59-44d0-ba79-eb82bead21f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:20.936303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed82e09-2b59-44d0-ba79-eb82bead21f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:20.936772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aed82e09-2b59-44d0-ba79-eb82bead21f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:20.964829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aed82e09-2b59-44d0-ba79-eb82bead21f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040048 Mar 08 13:29:20.965365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 913/1743] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:21.939842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:21.940491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:21.947459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:21.947943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:21.948731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:21.949171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:22.018243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:22.025443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e3cd4fe1-159b-4358-8323-2c9d0163c1df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.089488 Mar 08 13:29:22.026007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 914/1744] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:22.030717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0b0c2eb8-28f8-4156-b30a-03f9b8d3122d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:22.031619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0b0c2eb8-28f8-4156-b30a-03f9b8d3122d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:22.037426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b0c2eb8-28f8-4156-b30a-03f9b8d3122d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:22.037883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b0c2eb8-28f8-4156-b30a-03f9b8d3122d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:22.038666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b0c2eb8-28f8-4156-b30a-03f9b8d3122d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:22.039110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b0c2eb8-28f8-4156-b30a-03f9b8d3122d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:22.066620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0b0c2eb8-28f8-4156-b30a-03f9b8d3122d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039611 Mar 08 13:29:22.067162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 915/1745] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:23.043108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:23.043901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:23.049977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:23.050429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:23.051192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:23.051627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:23.110275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:23.117886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c202c35c-2be6-423f-9dc8-51ab7db2b0aa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079221 Mar 08 13:29:23.118450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 916/1746] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:23 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:23.123264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-31a450a1-492d-4da4-8c0d-318c9f22fc61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:23.124435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-31a450a1-492d-4da4-8c0d-318c9f22fc61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:23.129978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31a450a1-492d-4da4-8c0d-318c9f22fc61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:23.130427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31a450a1-492d-4da4-8c0d-318c9f22fc61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:23.131188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31a450a1-492d-4da4-8c0d-318c9f22fc61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:23.131625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-31a450a1-492d-4da4-8c0d-318c9f22fc61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:23.159341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-31a450a1-492d-4da4-8c0d-318c9f22fc61 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039921 Mar 08 13:29:23.159879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 917/1747] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:24.134641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:24.135309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:24.141552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:24.141998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:24.142758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:24.143189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:24.201938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:24.209116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0b89b0be-1020-4670-a853-66bdc50019df tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078540 Mar 08 13:29:24.209675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 918/1748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:24.214112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3872cd78-92cf-4e9d-980e-3e4c8e2c6669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:24.214989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3872cd78-92cf-4e9d-980e-3e4c8e2c6669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:24.220255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3872cd78-92cf-4e9d-980e-3e4c8e2c6669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:24.220736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3872cd78-92cf-4e9d-980e-3e4c8e2c6669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:24.221501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3872cd78-92cf-4e9d-980e-3e4c8e2c6669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:24.221932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3872cd78-92cf-4e9d-980e-3e4c8e2c6669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:24.251575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3872cd78-92cf-4e9d-980e-3e4c8e2c6669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040930 Mar 08 13:29:24.252108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 919/1749] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:25.225909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:25.226755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:25.233814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:25.234281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:25.235068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:25.235528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:25.294984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:25.302474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b33c085c-7654-4cb7-9d00-33826abf02a5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080533 Mar 08 13:29:25.303038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 920/1750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:25.307725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-80204f67-929a-4104-be33-ff52c7ef95a5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:25.308637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-80204f67-929a-4104-be33-ff52c7ef95a5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:25.314157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80204f67-929a-4104-be33-ff52c7ef95a5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:25.314591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80204f67-929a-4104-be33-ff52c7ef95a5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:25.315348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80204f67-929a-4104-be33-ff52c7ef95a5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:25.315785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80204f67-929a-4104-be33-ff52c7ef95a5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:25.343989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-80204f67-929a-4104-be33-ff52c7ef95a5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039932 Mar 08 13:29:25.344539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 921/1751] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:26.318091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:26.318722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:26.325800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:26.326246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:26.327054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:26.327459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:26.391256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:26.398812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a08c818f-1581-44d7-9309-b89708f73c62 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084524 Mar 08 13:29:26.399376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 922/1752] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:26.403829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fe17e274-88b0-4a52-9beb-824a295bce1c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:26.404745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fe17e274-88b0-4a52-9beb-824a295bce1c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:26.410633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe17e274-88b0-4a52-9beb-824a295bce1c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:26.411233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe17e274-88b0-4a52-9beb-824a295bce1c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:26.412046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe17e274-88b0-4a52-9beb-824a295bce1c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:26.412482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fe17e274-88b0-4a52-9beb-824a295bce1c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:26.442572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fe17e274-88b0-4a52-9beb-824a295bce1c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042162 Mar 08 13:29:26.443144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 923/1753] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:27.416426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:27.417149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:27.423784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:27.424228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:27.425041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:27.425472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:27.484434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:27.491742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-870dde40-297e-4df5-84f3-d493f33005ee tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080267 Mar 08 13:29:27.492403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 924/1754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:27 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:27.496813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-66584658-0b6b-4472-a4e3-7fc1f1218e3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:27.497688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-66584658-0b6b-4472-a4e3-7fc1f1218e3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:27.503244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66584658-0b6b-4472-a4e3-7fc1f1218e3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:27.503691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66584658-0b6b-4472-a4e3-7fc1f1218e3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:27.504444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66584658-0b6b-4472-a4e3-7fc1f1218e3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:27.504903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66584658-0b6b-4472-a4e3-7fc1f1218e3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:27.539511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-66584658-0b6b-4472-a4e3-7fc1f1218e3b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045356 Mar 08 13:29:27.540058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 925/1755] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:28.508375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:28.509024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:28.515249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:28.515698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:28.516461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:28.516928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:28.575557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:28.582812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7cfd32c6-b30b-47af-a18c-ef42c3b30458 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078823 Mar 08 13:29:28.583366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 926/1756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:28.588535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-39148fa1-af85-43e0-a7df-4c6eb0506954 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:28.589470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-39148fa1-af85-43e0-a7df-4c6eb0506954 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:28.594983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-39148fa1-af85-43e0-a7df-4c6eb0506954 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:28.595440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-39148fa1-af85-43e0-a7df-4c6eb0506954 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:28.596214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-39148fa1-af85-43e0-a7df-4c6eb0506954 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:28.596664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-39148fa1-af85-43e0-a7df-4c6eb0506954 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:28.626257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-39148fa1-af85-43e0-a7df-4c6eb0506954 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041835 Mar 08 13:29:28.626726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 927/1757] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:29.599317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:29.599995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:29.606753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:29.607200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:29.607953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:29.608386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:29.667359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:29.674551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-405373a5-ad02-436d-a865-879164a4b5a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079140 Mar 08 13:29:29.675100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 928/1758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:29 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:29.679630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-806050f2-5cef-43bf-80fc-12e6f4b8b56d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:29.680512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-806050f2-5cef-43bf-80fc-12e6f4b8b56d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:29.685816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806050f2-5cef-43bf-80fc-12e6f4b8b56d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:29.686264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806050f2-5cef-43bf-80fc-12e6f4b8b56d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:29.687013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806050f2-5cef-43bf-80fc-12e6f4b8b56d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:29.687445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806050f2-5cef-43bf-80fc-12e6f4b8b56d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:29.715237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-806050f2-5cef-43bf-80fc-12e6f4b8b56d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039169 Mar 08 13:29:29.715776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 929/1759] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:30.691153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:30.691810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:30.698598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:30.699043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:30.699800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:30.700232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:30.759596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:30.767404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-75e9c766-1b0f-46b8-bac1-b4d52b40563f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080100 Mar 08 13:29:30.767966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 930/1760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:30.772595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6f812b4b-b6b7-4193-936b-a2ca41ad5eca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:30.773740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6f812b4b-b6b7-4193-936b-a2ca41ad5eca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:30.779251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f812b4b-b6b7-4193-936b-a2ca41ad5eca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:30.779713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f812b4b-b6b7-4193-936b-a2ca41ad5eca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:30.780446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f812b4b-b6b7-4193-936b-a2ca41ad5eca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:30.780907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f812b4b-b6b7-4193-936b-a2ca41ad5eca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:30.811674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6f812b4b-b6b7-4193-936b-a2ca41ad5eca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042635 Mar 08 13:29:30.812255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 931/1761] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:31.784338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:31.785037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:31.791885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:31.792333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:31.793165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:31.793598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:31.852925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:29:31.860151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bff6eb56-d7a7-4434-9c43-29827fe967e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079692 Mar 08 13:29:31.860733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 932/1762] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:29:31 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:29:31.865301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-87ec43d3-96df-486f-aae7-a9f007099912 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:31.867392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-87ec43d3-96df-486f-aae7-a9f007099912 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:31.872522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87ec43d3-96df-486f-aae7-a9f007099912 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:31.872987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87ec43d3-96df-486f-aae7-a9f007099912 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:31.873784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87ec43d3-96df-486f-aae7-a9f007099912 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:31.874520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87ec43d3-96df-486f-aae7-a9f007099912 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:31.903405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-87ec43d3-96df-486f-aae7-a9f007099912 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041655 Mar 08 13:29:31.903956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 933/1763] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:29:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:29:32.637583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:29:32.638006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:29:32.643915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:32.644364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:29:32.645161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:29:32.645600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:33.086664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fa8e0a6a-0757-45dd-b122-c7ed0b2f71c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e" status: 202 len: 0 microversion: 2.1 time: 120.513615 Mar 08 13:30:33.087361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 831/1764] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:28:32 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e => generated 0 bytes in 120515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:30:33.093426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:33.094226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:33.102563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:33.103015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:33.103804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:33.104246 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:33.180237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:33.189655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d4014c1b-b5e1-4ae8-a5f9-955673178095 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.101105 Mar 08 13:30:33.190232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 832/1765] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:33 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:30:33.197210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-73f7c53b-9dab-46ed-bb9c-91543ac9ce39 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:33.198163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-73f7c53b-9dab-46ed-bb9c-91543ac9ce39 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:33.204564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f7c53b-9dab-46ed-bb9c-91543ac9ce39 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:33.205134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f7c53b-9dab-46ed-bb9c-91543ac9ce39 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:33.205906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f7c53b-9dab-46ed-bb9c-91543ac9ce39 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:33.206338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f7c53b-9dab-46ed-bb9c-91543ac9ce39 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:33.237026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-73f7c53b-9dab-46ed-bb9c-91543ac9ce39 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045413 Mar 08 13:30:33.237596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 833/1766] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:33.243083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:33.243570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:33.249436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:33.250043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:33.250803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:33.251233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:33.429380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid 3bb7cf51-102c-4301-941a-338b211f4ddb {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:30:35.453888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:30:35.454733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:30:40.348398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid 3bb7cf51-102c-4301-941a-338b211f4ddb {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:30:40.377006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08301f0b-5047-43e3-a0a2-edc2acf27a6c) Mar 08 13:30:40.377620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-08301f0b-5047-43e3-a0a2-edc2acf27a6c) {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:30:40.378470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f3682e15-d9a0-4688-a27b-cd37935adcfc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e" status: 400 len: 269 microversion: 2.1 time: 67.745010 Mar 08 13:30:40.379035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 934/1767] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:29:32 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e => generated 269 bytes in 67746 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:30:40.386516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:40.387125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:40.397800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:40.398255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:40.399034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:40.399460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:40.491634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:40.499907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-375ebbf0-3736-4144-afa6-cdfbdf8ebbcc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.119612 Mar 08 13:30:40.500466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 935/1768] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:40 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:30:40.506841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f173905e-6b34-4c3f-bca6-d26f28e8b700 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:40.507794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f173905e-6b34-4c3f-bca6-d26f28e8b700 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:40.513898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f173905e-6b34-4c3f-bca6-d26f28e8b700 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:40.514313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f173905e-6b34-4c3f-bca6-d26f28e8b700 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:40.515076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f173905e-6b34-4c3f-bca6-d26f28e8b700 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:40.515507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f173905e-6b34-4c3f-bca6-d26f28e8b700 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:40.552008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f173905e-6b34-4c3f-bca6-d26f28e8b700 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049581 Mar 08 13:30:40.552919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 936/1769] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:41.082155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:41.082656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:41.089635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:41.090095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:41.090874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:41.091313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:41.117152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:30:41.228183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.compute.api [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Instance is already in deleting state, ignoring this request Mar 08 13:30:41.228992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6296d864-c0f4-4cef-aee2-4b004d69d2f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 204 len: 0 microversion: 2.1 time: 0.150833 Mar 08 13:30:41.229569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 937/1770] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:30:41 2022] DELETE /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 13:30:41.237608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:41.240244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:41.244943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:41.245369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:41.246165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:41.246598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:41.316258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:41.325162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-091c533d-9d72-4fd8-9383-fda534815855 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.091139 Mar 08 13:30:41.328977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 938/1771] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:30:41.563988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-44b421f2-23da-4fb7-8ffe-0f2b21622e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:41.564864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-44b421f2-23da-4fb7-8ffe-0f2b21622e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:41.571667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b421f2-23da-4fb7-8ffe-0f2b21622e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:41.572126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b421f2-23da-4fb7-8ffe-0f2b21622e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:41.572944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b421f2-23da-4fb7-8ffe-0f2b21622e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:41.573418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44b421f2-23da-4fb7-8ffe-0f2b21622e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:41.604702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-44b421f2-23da-4fb7-8ffe-0f2b21622e69 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Mar 08 13:30:41.605540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 939/1772] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:30:42.343292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:42.344080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:42.351251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:42.351729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:42.352558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:42.353060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:42.418746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:42.426308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-715ce54c-bb87-4619-9f4d-a816985d0f26 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087051 Mar 08 13:30:42.431978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 940/1773] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:42.618906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40990e63-35a3-48f7-be0d-c92b3e13ffe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:42.619878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40990e63-35a3-48f7-be0d-c92b3e13ffe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:42.626251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40990e63-35a3-48f7-be0d-c92b3e13ffe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:42.626742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40990e63-35a3-48f7-be0d-c92b3e13ffe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:42.627468 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40990e63-35a3-48f7-be0d-c92b3e13ffe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:42.627904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40990e63-35a3-48f7-be0d-c92b3e13ffe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:42.656400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40990e63-35a3-48f7-be0d-c92b3e13ffe8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044721 Mar 08 13:30:42.657147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 941/1774] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:30:43.445625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:43.446245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:43.452676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:43.453438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:43.454542 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:43.455045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:43.514618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:43.522087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be462f79-03fe-407a-ba2b-807b93fab966 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082659 Mar 08 13:30:43.522862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 942/1775] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:43 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:43.668044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3c0b132d-868a-416e-942d-23e68ad35fa3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:43.668974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3c0b132d-868a-416e-942d-23e68ad35fa3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:43.674846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c0b132d-868a-416e-942d-23e68ad35fa3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:43.675302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c0b132d-868a-416e-942d-23e68ad35fa3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:43.676071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c0b132d-868a-416e-942d-23e68ad35fa3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:43.676512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c0b132d-868a-416e-942d-23e68ad35fa3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:43.704776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3c0b132d-868a-416e-942d-23e68ad35fa3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040796 Mar 08 13:30:43.705464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 943/1776] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:43 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:30:44.539711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:44.540350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:44.546593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:44.547044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:44.547803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:44.548238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:44.610217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:44.618458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-00832da3-f589-4d40-91ae-d0bcec93afe2 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082766 Mar 08 13:30:44.619020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 944/1777] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:44 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:44.715303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-44c413b5-d5b6-43fb-a0b3-67ab07273c94 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:44.716197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-44c413b5-d5b6-43fb-a0b3-67ab07273c94 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:44.721897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44c413b5-d5b6-43fb-a0b3-67ab07273c94 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:44.722343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44c413b5-d5b6-43fb-a0b3-67ab07273c94 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:44.723103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44c413b5-d5b6-43fb-a0b3-67ab07273c94 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:44.723538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44c413b5-d5b6-43fb-a0b3-67ab07273c94 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:44.751795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-44c413b5-d5b6-43fb-a0b3-67ab07273c94 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040403 Mar 08 13:30:44.752335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 945/1778] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:30:45.635764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:45.636328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:45.642226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:45.642672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:45.643437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:45.643870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:45.701545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:45.709197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-61ab62c5-3fd4-4f9e-bdcf-a4b26b1f9ae4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.076912 Mar 08 13:30:45.709819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 946/1779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:45 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:45.762985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cfc30b96-1b46-4b10-90c8-406ae224ba0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:45.763886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cfc30b96-1b46-4b10-90c8-406ae224ba0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:45.769914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfc30b96-1b46-4b10-90c8-406ae224ba0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:45.770361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfc30b96-1b46-4b10-90c8-406ae224ba0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:45.771738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfc30b96-1b46-4b10-90c8-406ae224ba0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:45.772237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cfc30b96-1b46-4b10-90c8-406ae224ba0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:45.801694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cfc30b96-1b46-4b10-90c8-406ae224ba0d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042414 Mar 08 13:30:45.802237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 947/1780] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:30:46.726440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:46.727046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:46.733003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:46.733454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:46.734210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:46.734647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:46.747845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:30:46.748323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:30:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:30:46.793532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:46.800783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-08ddd063-af3e-408f-9a24-fc58d9b3b868 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078793 Mar 08 13:30:46.801349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 948/1781] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:46.812960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f70172c7-925a-4882-b759-3bd9d9cce480 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:46.813855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f70172c7-925a-4882-b759-3bd9d9cce480 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:46.819728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f70172c7-925a-4882-b759-3bd9d9cce480 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:46.820170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f70172c7-925a-4882-b759-3bd9d9cce480 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:46.820964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f70172c7-925a-4882-b759-3bd9d9cce480 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:46.821420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f70172c7-925a-4882-b759-3bd9d9cce480 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:46.852637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f70172c7-925a-4882-b759-3bd9d9cce480 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043064 Mar 08 13:30:46.853224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 949/1782] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:30:47.817609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:47.818909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:47.825168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:47.825619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:47.826383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:47.826823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:47.887830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:47.895148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5358453d-5371-4753-986d-723c1c415977 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081407 Mar 08 13:30:47.895701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 950/1783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:47.900357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f034b1f0-617a-4e2c-bf18-40d50e97440b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:47.901280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f034b1f0-617a-4e2c-bf18-40d50e97440b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:47.906707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f034b1f0-617a-4e2c-bf18-40d50e97440b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:47.907151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f034b1f0-617a-4e2c-bf18-40d50e97440b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:47.907904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f034b1f0-617a-4e2c-bf18-40d50e97440b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:47.908330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f034b1f0-617a-4e2c-bf18-40d50e97440b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:47.936238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f034b1f0-617a-4e2c-bf18-40d50e97440b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039392 Mar 08 13:30:47.936792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 951/1784] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:48.912557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:48.913307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:48.919491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:48.919929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:48.920701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:48.921135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:48.980220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:48.987549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9284a8d3-1fdf-43d4-bb58-0df37e7b583d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079394 Mar 08 13:30:48.988151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 952/1785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:48 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:48.993427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b55cf9d4-6c3f-4fee-9353-41159e6316ff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:48.994309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b55cf9d4-6c3f-4fee-9353-41159e6316ff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:48.999990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b55cf9d4-6c3f-4fee-9353-41159e6316ff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:49.000433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b55cf9d4-6c3f-4fee-9353-41159e6316ff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:49.001236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b55cf9d4-6c3f-4fee-9353-41159e6316ff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:49.001651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b55cf9d4-6c3f-4fee-9353-41159e6316ff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:49.030686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b55cf9d4-6c3f-4fee-9353-41159e6316ff tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041469 Mar 08 13:30:49.031238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 953/1786] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:48 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:49.230730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:30:49.231182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:30:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:30:50.133742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:50.134358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:50.140200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:50.140647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:50.141450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:50.141885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:50.200256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:50.207490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0de39539-381c-46bf-a635-819baf71898f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.205857 Mar 08 13:30:50.208049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 954/1787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:50.212688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b7e131e0-7bee-4672-b28c-abd08886d9a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:50.213590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b7e131e0-7bee-4672-b28c-abd08886d9a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:50.218993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7e131e0-7bee-4672-b28c-abd08886d9a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:50.219443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7e131e0-7bee-4672-b28c-abd08886d9a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:50.220203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7e131e0-7bee-4672-b28c-abd08886d9a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:50.220681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7e131e0-7bee-4672-b28c-abd08886d9a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:50.249582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b7e131e0-7bee-4672-b28c-abd08886d9a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040443 Mar 08 13:30:50.250133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 955/1788] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:51.224321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:51.225054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:51.231310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:51.231762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:51.232524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:51.232996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:51.295218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:51.302481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-527bbfcd-7335-48dd-82df-8d1a3fb48812 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082135 Mar 08 13:30:51.303040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 956/1789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:51.307484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-953abbb0-5ad5-4212-812d-4e59e71cdbec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:51.308370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-953abbb0-5ad5-4212-812d-4e59e71cdbec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:51.313926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-953abbb0-5ad5-4212-812d-4e59e71cdbec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:51.314379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-953abbb0-5ad5-4212-812d-4e59e71cdbec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:51.315144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-953abbb0-5ad5-4212-812d-4e59e71cdbec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:51.315578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-953abbb0-5ad5-4212-812d-4e59e71cdbec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:51.345096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-953abbb0-5ad5-4212-812d-4e59e71cdbec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041003 Mar 08 13:30:51.345654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 957/1790] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:52.318461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:52.319106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:52.325494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:52.325943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:52.326721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:52.327150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:52.386142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:52.393595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e70b0938-7bf0-4b0f-8bf1-3635acf92871 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079184 Mar 08 13:30:52.394154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 958/1791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:52 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:52.399289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a02658e8-5311-47e9-a515-7f737f179791 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:52.400164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a02658e8-5311-47e9-a515-7f737f179791 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:52.405554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a02658e8-5311-47e9-a515-7f737f179791 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:52.405999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a02658e8-5311-47e9-a515-7f737f179791 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:52.406747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a02658e8-5311-47e9-a515-7f737f179791 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:52.407176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a02658e8-5311-47e9-a515-7f737f179791 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:52.437207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a02658e8-5311-47e9-a515-7f737f179791 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041991 Mar 08 13:30:52.437957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 959/1792] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:53.410838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:53.411485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:53.418638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:53.419085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:53.419843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:53.420275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:53.480433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:53.487976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3d6c3538-cba6-4b53-a7e7-704e0c31b055 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081053 Mar 08 13:30:53.488525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 960/1793] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:53 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:53.493650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ad1983e7-06c6-4538-b93f-cedc3382f98b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:53.494533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ad1983e7-06c6-4538-b93f-cedc3382f98b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:53.500767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad1983e7-06c6-4538-b93f-cedc3382f98b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:53.501079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad1983e7-06c6-4538-b93f-cedc3382f98b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:53.501840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad1983e7-06c6-4538-b93f-cedc3382f98b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:53.502292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad1983e7-06c6-4538-b93f-cedc3382f98b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:53.530339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ad1983e7-06c6-4538-b93f-cedc3382f98b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040769 Mar 08 13:30:53.530886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 961/1794] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:54.505973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:54.506702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:54.512930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:54.513379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:54.514147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:54.514583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:54.574801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:54.582125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0c29adc-3dbb-4488-b5ef-184ace5a8059 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080216 Mar 08 13:30:54.582678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 962/1795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:54 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:54.587284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-13b29816-edc4-4759-b024-ba41ceec8126 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:54.588167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-13b29816-edc4-4759-b024-ba41ceec8126 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:54.594352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13b29816-edc4-4759-b024-ba41ceec8126 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:54.594807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13b29816-edc4-4759-b024-ba41ceec8126 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:54.595625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13b29816-edc4-4759-b024-ba41ceec8126 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:54.596060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13b29816-edc4-4759-b024-ba41ceec8126 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:54.624381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-13b29816-edc4-4759-b024-ba41ceec8126 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040722 Mar 08 13:30:54.624967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 963/1796] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:55.599233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:55.599930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:55.606697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:55.607139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:55.607898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:55.608327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:55.668769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:55.676013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-446547fb-4c96-4ed5-a13b-f078747fd699 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080681 Mar 08 13:30:55.676567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 964/1797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:55.681410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f0c8c0aa-de91-4db1-9780-895a8ca09f7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:55.682287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f0c8c0aa-de91-4db1-9780-895a8ca09f7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:55.687690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c8c0aa-de91-4db1-9780-895a8ca09f7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:55.688137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c8c0aa-de91-4db1-9780-895a8ca09f7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:55.688915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c8c0aa-de91-4db1-9780-895a8ca09f7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:55.689343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0c8c0aa-de91-4db1-9780-895a8ca09f7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:55.717501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f0c8c0aa-de91-4db1-9780-895a8ca09f7b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039943 Mar 08 13:30:55.718061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 965/1798] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:55 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:56.692877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:56.693538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:56.699779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:56.700232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:56.701032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:56.701474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:56.760928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:56.768243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dd7cf58e-d608-4ecf-bd07-bfe228f60716 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079423 Mar 08 13:30:56.768888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 966/1799] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:56 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:56.773608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b484970e-5848-4f80-979d-aa88b7db5305 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:56.774499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b484970e-5848-4f80-979d-aa88b7db5305 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:56.779889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b484970e-5848-4f80-979d-aa88b7db5305 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:56.780345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b484970e-5848-4f80-979d-aa88b7db5305 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:56.781149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b484970e-5848-4f80-979d-aa88b7db5305 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:56.781586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b484970e-5848-4f80-979d-aa88b7db5305 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:56.811452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b484970e-5848-4f80-979d-aa88b7db5305 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041501 Mar 08 13:30:56.812005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 967/1800] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:57.785321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:57.785993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:57.792591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:57.793082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:57.793866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:57.794309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:57.863292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:57.872623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7883d249-2af7-4974-b8f1-90b1a5f1c538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.090874 Mar 08 13:30:57.873279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 968/1801] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:57.877941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-414bf070-7157-4af3-9d01-4c8f9e7e4e32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:57.878854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-414bf070-7157-4af3-9d01-4c8f9e7e4e32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:57.885644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-414bf070-7157-4af3-9d01-4c8f9e7e4e32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:57.886096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-414bf070-7157-4af3-9d01-4c8f9e7e4e32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:57.886883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-414bf070-7157-4af3-9d01-4c8f9e7e4e32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:57.887322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-414bf070-7157-4af3-9d01-4c8f9e7e4e32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:57.914853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-414bf070-7157-4af3-9d01-4c8f9e7e4e32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040588 Mar 08 13:30:57.915394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 969/1802] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:58.891025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:58.891702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:58.899014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:58.899534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:58.900344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:58.900856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:58.961394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:30:58.968700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c1edcb9e-2661-43e8-891e-6d1d956889bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081740 Mar 08 13:30:58.969261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 970/1803] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:30:58.973855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8666e4e3-4804-4319-96dd-3fd33e19f17c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:58.974746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8666e4e3-4804-4319-96dd-3fd33e19f17c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:58.980631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8666e4e3-4804-4319-96dd-3fd33e19f17c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:58.981122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8666e4e3-4804-4319-96dd-3fd33e19f17c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:58.981897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8666e4e3-4804-4319-96dd-3fd33e19f17c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:58.982339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8666e4e3-4804-4319-96dd-3fd33e19f17c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:59.011569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8666e4e3-4804-4319-96dd-3fd33e19f17c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041290 Mar 08 13:30:59.012118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 971/1804] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:30:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:30:59.846060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:30:59.846283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:30:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:30:59.986332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:30:59.987004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:30:59.993918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:59.994418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:30:59.995239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:30:59.995695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:00.058313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:00.065790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3093c235-e92b-45da-bcfd-3c813d4f63e5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083392 Mar 08 13:31:00.066450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 972/1805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:30:59 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:00.071013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5b74a98c-bba5-44d4-8d99-5d3a70dd61ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:00.071902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5b74a98c-bba5-44d4-8d99-5d3a70dd61ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:00.077465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b74a98c-bba5-44d4-8d99-5d3a70dd61ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:00.077920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b74a98c-bba5-44d4-8d99-5d3a70dd61ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:00.078686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b74a98c-bba5-44d4-8d99-5d3a70dd61ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:00.079128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b74a98c-bba5-44d4-8d99-5d3a70dd61ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:00.108577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5b74a98c-bba5-44d4-8d99-5d3a70dd61ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041058 Mar 08 13:31:00.109101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 973/1806] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:00 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:01.083011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:01.083685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:01.090003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:01.090452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:01.091209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:01.091641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:01.151403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:01.159498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-caeeef52-5c8c-47a3-a9c6-a57b1e1ee1e4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080289 Mar 08 13:31:01.160186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 974/1807] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:01.165697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8d5d5558-f53a-42c3-92e5-0d45a52a69ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:01.166710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8d5d5558-f53a-42c3-92e5-0d45a52a69ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:01.173006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d5d5558-f53a-42c3-92e5-0d45a52a69ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:01.173528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d5d5558-f53a-42c3-92e5-0d45a52a69ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:01.174399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d5d5558-f53a-42c3-92e5-0d45a52a69ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:01.174911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d5d5558-f53a-42c3-92e5-0d45a52a69ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:01.204297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8d5d5558-f53a-42c3-92e5-0d45a52a69ca tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043053 Mar 08 13:31:01.204873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 975/1808] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:02.177334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:02.177994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:02.185156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:02.185603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:02.186413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:02.186923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:02.252507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:02.260725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-067afa72-f99e-488b-92a1-c8a7b5305495 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087599 Mar 08 13:31:02.261300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 976/1809] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:02.265983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a0b13db1-3606-4b17-9481-c9e21473bc16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:02.266878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a0b13db1-3606-4b17-9481-c9e21473bc16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:02.272744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0b13db1-3606-4b17-9481-c9e21473bc16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:02.273206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0b13db1-3606-4b17-9481-c9e21473bc16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:02.274028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0b13db1-3606-4b17-9481-c9e21473bc16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:02.274490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0b13db1-3606-4b17-9481-c9e21473bc16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:02.305321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a0b13db1-3606-4b17-9481-c9e21473bc16 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042920 Mar 08 13:31:02.305878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 977/1810] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:03.278103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:03.278796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:03.285324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:03.285817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:03.286587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:03.287030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:03.347701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:03.355933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1fbdcb21-6e1e-4c9d-8abe-23f593beed79 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081877 Mar 08 13:31:03.356487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 978/1811] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:03 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:03.361136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-79c13ed2-35ab-4959-802b-ecac17070151 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:03.362088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79c13ed2-35ab-4959-802b-ecac17070151 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:03.368310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79c13ed2-35ab-4959-802b-ecac17070151 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:03.368781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79c13ed2-35ab-4959-802b-ecac17070151 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:03.369550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79c13ed2-35ab-4959-802b-ecac17070151 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:03.369983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79c13ed2-35ab-4959-802b-ecac17070151 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:03.397907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-79c13ed2-35ab-4959-802b-ecac17070151 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040392 Mar 08 13:31:03.398478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 979/1812] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:04.373354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:04.373985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:04.380204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:04.380670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:04.381451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:04.381890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:04.449424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:04.456772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f5eda4a7-634b-4623-bd3b-abd48db810ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087712 Mar 08 13:31:04.457334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 980/1813] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:31:04.462181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f676966e-9449-4386-a5a0-c85432cd4404 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:04.463071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f676966e-9449-4386-a5a0-c85432cd4404 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:04.468746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f676966e-9449-4386-a5a0-c85432cd4404 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:04.469234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f676966e-9449-4386-a5a0-c85432cd4404 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:04.470004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f676966e-9449-4386-a5a0-c85432cd4404 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:04.470442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f676966e-9449-4386-a5a0-c85432cd4404 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:04.500179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f676966e-9449-4386-a5a0-c85432cd4404 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041823 Mar 08 13:31:04.500804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 981/1814] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:05.474683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:05.475337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:05.482512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:05.485217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:05.485217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:05.485217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:05.544504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:05.552071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f8470470-d0b0-4bf9-893b-7c2aad7fbc4d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081377 Mar 08 13:31:05.557765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 982/1815] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:05.557765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1d7a462e-99d2-4759-bc33-e55df24f7f56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:05.558324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1d7a462e-99d2-4759-bc33-e55df24f7f56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:05.563852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d7a462e-99d2-4759-bc33-e55df24f7f56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:05.564297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d7a462e-99d2-4759-bc33-e55df24f7f56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:05.565160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d7a462e-99d2-4759-bc33-e55df24f7f56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:05.565598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d7a462e-99d2-4759-bc33-e55df24f7f56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:05.594533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1d7a462e-99d2-4759-bc33-e55df24f7f56 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040865 Mar 08 13:31:05.595078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 983/1816] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:06.571038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:06.571738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:06.578938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:06.579395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:06.580166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:06.580606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:06.643177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:06.650535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42eac98c-9512-494e-ac33-9c64a1834c18 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085277 Mar 08 13:31:06.651114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 984/1817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:06 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:06.655631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d6fb548c-53b8-47ce-9200-12d88462fb59 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:06.656522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d6fb548c-53b8-47ce-9200-12d88462fb59 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:06.661888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6fb548c-53b8-47ce-9200-12d88462fb59 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:06.662356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6fb548c-53b8-47ce-9200-12d88462fb59 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:06.663137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6fb548c-53b8-47ce-9200-12d88462fb59 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:06.664144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d6fb548c-53b8-47ce-9200-12d88462fb59 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:06.692280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d6fb548c-53b8-47ce-9200-12d88462fb59 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040183 Mar 08 13:31:06.692857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 985/1818] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:07.667773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:07.668423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:07.674597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:07.675051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:07.675819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:07.676256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:07.736510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:07.744859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f37f05c7-bbb4-463e-b885-52160950af82 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081437 Mar 08 13:31:07.745430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 986/1819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:07 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:07.750180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee4d06dd-75e7-4c4e-a94c-58ee60bddcb5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:07.751074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee4d06dd-75e7-4c4e-a94c-58ee60bddcb5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:07.756461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4d06dd-75e7-4c4e-a94c-58ee60bddcb5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:07.756942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4d06dd-75e7-4c4e-a94c-58ee60bddcb5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:07.758855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4d06dd-75e7-4c4e-a94c-58ee60bddcb5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:07.759299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee4d06dd-75e7-4c4e-a94c-58ee60bddcb5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:07.787074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee4d06dd-75e7-4c4e-a94c-58ee60bddcb5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040666 Mar 08 13:31:07.787618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 987/1820] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:07 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:08.762204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:08.762897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:08.769091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:08.769538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:08.770295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:08.770730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:08.830152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:08.837981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-260aedcb-bcf5-4afa-ae7f-071f51b3e7c0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079776 Mar 08 13:31:08.838543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 988/1821] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:08 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:08.843036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-716ce920-4d74-4c0c-8079-f94f2ce11c3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:08.843914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-716ce920-4d74-4c0c-8079-f94f2ce11c3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:08.849320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-716ce920-4d74-4c0c-8079-f94f2ce11c3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:08.849769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-716ce920-4d74-4c0c-8079-f94f2ce11c3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:08.850518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-716ce920-4d74-4c0c-8079-f94f2ce11c3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:08.850948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-716ce920-4d74-4c0c-8079-f94f2ce11c3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:08.878277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-716ce920-4d74-4c0c-8079-f94f2ce11c3d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038770 Mar 08 13:31:08.878846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 989/1822] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:09.854793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:09.855469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:09.861613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:09.862057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:09.862808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:09.863240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:09.921800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:09.929833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-16dff274-8775-4d5d-b7f9-d1a415f1e4e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078332 Mar 08 13:31:09.930395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 990/1823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:09.935043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2e8e2c3a-4eb5-466e-be17-eeee3103da87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:09.935925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2e8e2c3a-4eb5-466e-be17-eeee3103da87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:09.941422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c3a-4eb5-466e-be17-eeee3103da87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:09.941874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c3a-4eb5-466e-be17-eeee3103da87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:09.942625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c3a-4eb5-466e-be17-eeee3103da87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:09.943054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e8e2c3a-4eb5-466e-be17-eeee3103da87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:09.971556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2e8e2c3a-4eb5-466e-be17-eeee3103da87 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040140 Mar 08 13:31:09.972104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 991/1824] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:10.947069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:10.947740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:10.953918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:10.954370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:10.955135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:10.955584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:11.016982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:11.024941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9d1f6049-8d14-4dc3-955b-5bf0f97813a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082359 Mar 08 13:31:11.025501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 992/1825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:11.029945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a8bc942d-d483-4d03-9c8c-8755afa03600 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:11.030825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a8bc942d-d483-4d03-9c8c-8755afa03600 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:11.036099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8bc942d-d483-4d03-9c8c-8755afa03600 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:11.036544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8bc942d-d483-4d03-9c8c-8755afa03600 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:11.037340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8bc942d-d483-4d03-9c8c-8755afa03600 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:11.037773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a8bc942d-d483-4d03-9c8c-8755afa03600 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:11.064888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a8bc942d-d483-4d03-9c8c-8755afa03600 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038374 Mar 08 13:31:11.065418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 993/1826] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:12.042331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:12.043011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:12.049164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:12.049649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:12.050418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:12.050857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:12.109704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:12.117155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d704a978-d17e-4d23-b99d-0504ad13a492 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079327 Mar 08 13:31:12.117719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 994/1827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:12.122447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a5c8c843-e3ab-4559-bd82-db0da3a39686 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:12.123507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a5c8c843-e3ab-4559-bd82-db0da3a39686 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:12.129062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5c8c843-e3ab-4559-bd82-db0da3a39686 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:12.129505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5c8c843-e3ab-4559-bd82-db0da3a39686 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:12.130282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5c8c843-e3ab-4559-bd82-db0da3a39686 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:12.130701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5c8c843-e3ab-4559-bd82-db0da3a39686 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:12.158887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a5c8c843-e3ab-4559-bd82-db0da3a39686 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040186 Mar 08 13:31:12.159433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 995/1828] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:13.134838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:13.135522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:13.141844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:13.142386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:13.143189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:13.143625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:13.206065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:13.213952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8aac2dfd-7c7e-42a5-9062-44e91a215fe1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083550 Mar 08 13:31:13.214520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 996/1829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:13.219070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eda2fcb1-6bd0-4e16-b986-744447c5340c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:13.219956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eda2fcb1-6bd0-4e16-b986-744447c5340c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:13.225625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eda2fcb1-6bd0-4e16-b986-744447c5340c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:13.226071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eda2fcb1-6bd0-4e16-b986-744447c5340c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:13.226832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eda2fcb1-6bd0-4e16-b986-744447c5340c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:13.227262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eda2fcb1-6bd0-4e16-b986-744447c5340c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:13.254693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eda2fcb1-6bd0-4e16-b986-744447c5340c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039207 Mar 08 13:31:13.255271 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 997/1830] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:14.231098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:14.231835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:14.238426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:14.238806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:14.239575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:14.240012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:14.306808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:14.314392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58cb2202-1f8f-4c27-8430-68bae151accf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.087169 Mar 08 13:31:14.314958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 998/1831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:14 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:14.319655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ff4b3f42-5780-4bab-89f4-3b077e0eaaf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:14.320537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ff4b3f42-5780-4bab-89f4-3b077e0eaaf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:14.329177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff4b3f42-5780-4bab-89f4-3b077e0eaaf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:14.329626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff4b3f42-5780-4bab-89f4-3b077e0eaaf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:14.330576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff4b3f42-5780-4bab-89f4-3b077e0eaaf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:14.331012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff4b3f42-5780-4bab-89f4-3b077e0eaaf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:14.375844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ff4b3f42-5780-4bab-89f4-3b077e0eaaf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059738 Mar 08 13:31:14.376321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 999/1832] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:14 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:15.333120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:15.333779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:15.339694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:15.340146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:15.340938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:15.341376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:15.400219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:15.407470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77dabee8-3174-4566-991e-13c6992dc92b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078401 Mar 08 13:31:15.408027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1000/1833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:15 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:15.412499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-08063331-16fd-48f2-903a-ab0dbcee9614 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:15.414029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-08063331-16fd-48f2-903a-ab0dbcee9614 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:15.419447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08063331-16fd-48f2-903a-ab0dbcee9614 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:15.419895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08063331-16fd-48f2-903a-ab0dbcee9614 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:15.420651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08063331-16fd-48f2-903a-ab0dbcee9614 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:15.421109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-08063331-16fd-48f2-903a-ab0dbcee9614 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:15.449550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-08063331-16fd-48f2-903a-ab0dbcee9614 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040511 Mar 08 13:31:15.450114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1001/1834] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:16.425226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:16.425860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:16.432921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:16.433371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:16.434166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:16.434599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:16.494135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:16.501746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f5ea9472-557e-460d-8d32-ab09340ad1ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080606 Mar 08 13:31:16.502321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1002/1835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:16.510756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-863bdf9e-aeec-4e4b-834b-667ae11da71c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:16.510756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-863bdf9e-aeec-4e4b-834b-667ae11da71c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:16.514246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-863bdf9e-aeec-4e4b-834b-667ae11da71c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:16.514788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-863bdf9e-aeec-4e4b-834b-667ae11da71c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:16.515566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-863bdf9e-aeec-4e4b-834b-667ae11da71c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:16.516035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-863bdf9e-aeec-4e4b-834b-667ae11da71c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:16.545763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-863bdf9e-aeec-4e4b-834b-667ae11da71c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042412 Mar 08 13:31:16.546328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1003/1836] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:17.519625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:17.520259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:17.527083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:17.527526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:17.528291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:17.528960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:17.592388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:17.600000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8190288a-8917-4b1a-92e2-c642b9a5b0cf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084577 Mar 08 13:31:17.600506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1004/1837] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:17 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:17.605122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d171c3cb-74ae-4e34-bafc-b6064123d2b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:17.606018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d171c3cb-74ae-4e34-bafc-b6064123d2b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:17.611944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d171c3cb-74ae-4e34-bafc-b6064123d2b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:17.612391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d171c3cb-74ae-4e34-bafc-b6064123d2b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:17.613201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d171c3cb-74ae-4e34-bafc-b6064123d2b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:17.613632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d171c3cb-74ae-4e34-bafc-b6064123d2b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:17.643173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d171c3cb-74ae-4e34-bafc-b6064123d2b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041650 Mar 08 13:31:17.643713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1005/1838] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:18.617775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:18.618459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:18.624903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:18.625351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:18.626111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:18.626548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:18.688862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:18.696625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-07191db3-9c70-4392-8440-dd879b5f966c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083630 Mar 08 13:31:18.697221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1006/1839] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:18.701763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c05536fc-4216-4cbf-b017-b4b85d9a0921 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:18.702650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c05536fc-4216-4cbf-b017-b4b85d9a0921 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:18.708287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c05536fc-4216-4cbf-b017-b4b85d9a0921 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:18.708774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c05536fc-4216-4cbf-b017-b4b85d9a0921 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:18.709538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c05536fc-4216-4cbf-b017-b4b85d9a0921 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:18.710483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c05536fc-4216-4cbf-b017-b4b85d9a0921 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:18.744045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c05536fc-4216-4cbf-b017-b4b85d9a0921 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045836 Mar 08 13:31:18.744603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1007/1840] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:19.713191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:19.713894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:19.720174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:19.720619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:19.721398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:19.722162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:19.784382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:19.792257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d3a7b790-096f-414d-831a-46cd4ef610e1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082967 Mar 08 13:31:19.792854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1008/1841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:19.797430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d707ca58-049f-4210-9557-e8896467d19f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:19.798350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d707ca58-049f-4210-9557-e8896467d19f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:19.804300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707ca58-049f-4210-9557-e8896467d19f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:19.804791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707ca58-049f-4210-9557-e8896467d19f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:19.805555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707ca58-049f-4210-9557-e8896467d19f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:19.805993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707ca58-049f-4210-9557-e8896467d19f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:19.833821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d707ca58-049f-4210-9557-e8896467d19f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039961 Mar 08 13:31:19.834365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1009/1842] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:19 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:20.809712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:20.810368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:20.816598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:20.817030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:20.817797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:20.818229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:20.877151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:20.884559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c4f6651a-9385-4815-bae8-c670a5e1d8a4 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078779 Mar 08 13:31:20.885152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1010/1843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:20 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:20.889636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-69fa6d5a-a212-4018-88a5-25654c06b3ec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:20.890523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-69fa6d5a-a212-4018-88a5-25654c06b3ec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:20.895960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69fa6d5a-a212-4018-88a5-25654c06b3ec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:20.896409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69fa6d5a-a212-4018-88a5-25654c06b3ec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:20.897313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69fa6d5a-a212-4018-88a5-25654c06b3ec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:20.897867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69fa6d5a-a212-4018-88a5-25654c06b3ec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:20.926191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-69fa6d5a-a212-4018-88a5-25654c06b3ec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040046 Mar 08 13:31:20.926745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1011/1844] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:21.902252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:21.902921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:21.909232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:21.909688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:21.910460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:21.910904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:21.986150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:21.994331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8f2f1881-0abc-45d1-b8c4-6d492f975629 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.095970 Mar 08 13:31:21.994891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1012/1845] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:21.999787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7eb991b5-0bca-404a-a9a5-8e6bf3f4175a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:22.000697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7eb991b5-0bca-404a-a9a5-8e6bf3f4175a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:22.006105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7eb991b5-0bca-404a-a9a5-8e6bf3f4175a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:22.006626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7eb991b5-0bca-404a-a9a5-8e6bf3f4175a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:22.008455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7eb991b5-0bca-404a-a9a5-8e6bf3f4175a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:22.008455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7eb991b5-0bca-404a-a9a5-8e6bf3f4175a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:22.037179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7eb991b5-0bca-404a-a9a5-8e6bf3f4175a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041302 Mar 08 13:31:22.037730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1013/1846] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:23.011813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:23.012467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:23.018839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:23.019268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:23.020028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:23.020456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:23.078291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:23.086113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3272cff1-fa5c-48a7-b0c7-c73a985384bd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078256 Mar 08 13:31:23.086668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1014/1847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:23 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:23.091147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8021510a-082b-42e0-9447-d83fb49a349e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:23.092025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8021510a-082b-42e0-9447-d83fb49a349e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:23.097705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8021510a-082b-42e0-9447-d83fb49a349e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:23.098163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8021510a-082b-42e0-9447-d83fb49a349e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:23.098968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8021510a-082b-42e0-9447-d83fb49a349e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:23.099412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8021510a-082b-42e0-9447-d83fb49a349e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:23.127643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8021510a-082b-42e0-9447-d83fb49a349e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039985 Mar 08 13:31:23.128199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1015/1848] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:24.104247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:24.105060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:24.112508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:24.113118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:24.114025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:24.114498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:24.178161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:24.185601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40f533c2-cdbb-4648-8838-34b7637eba58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.086859 Mar 08 13:31:24.186154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1016/1849] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:24.190655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62515964-613b-4c98-88f0-1d361d16fc3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:24.191537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-62515964-613b-4c98-88f0-1d361d16fc3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:24.197337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62515964-613b-4c98-88f0-1d361d16fc3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:24.197817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62515964-613b-4c98-88f0-1d361d16fc3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:24.198535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62515964-613b-4c98-88f0-1d361d16fc3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:24.198971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62515964-613b-4c98-88f0-1d361d16fc3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:24.227660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-62515964-613b-4c98-88f0-1d361d16fc3c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040527 Mar 08 13:31:24.228275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1017/1850] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:25.201639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:25.202331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:25.208428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:25.208904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:25.210294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:25.210728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:25.269252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:25.277322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42a6a1b3-eaa0-473c-81ac-a11632d5254f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079479 Mar 08 13:31:25.277887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1018/1851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:25.282365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3e36113f-f598-4dd2-81c2-6740d4dca93b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:25.283250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3e36113f-f598-4dd2-81c2-6740d4dca93b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:25.289588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e36113f-f598-4dd2-81c2-6740d4dca93b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:25.290374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e36113f-f598-4dd2-81c2-6740d4dca93b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:25.291732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e36113f-f598-4dd2-81c2-6740d4dca93b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:25.292458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e36113f-f598-4dd2-81c2-6740d4dca93b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:25.324394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3e36113f-f598-4dd2-81c2-6740d4dca93b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045473 Mar 08 13:31:25.324985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1019/1852] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:26.294117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:26.294769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:26.300914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:26.301364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:26.302158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:26.302592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:26.365141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:26.373441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-41f5e6a0-d644-4414-be40-cbba511cf67b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083088 Mar 08 13:31:26.374106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1020/1853] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:26.378688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8d2072de-fdbd-49d8-bb76-ec91eba9f8f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:26.379513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8d2072de-fdbd-49d8-bb76-ec91eba9f8f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:26.385586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d2072de-fdbd-49d8-bb76-ec91eba9f8f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:26.394443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d2072de-fdbd-49d8-bb76-ec91eba9f8f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:26.394443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d2072de-fdbd-49d8-bb76-ec91eba9f8f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:26.394443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d2072de-fdbd-49d8-bb76-ec91eba9f8f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:26.420376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8d2072de-fdbd-49d8-bb76-ec91eba9f8f2 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045221 Mar 08 13:31:26.420990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1021/1854] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:27.390726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:27.391379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:27.397816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:27.398269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:27.399035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:27.399490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:27.458004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:27.465548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-631d0603-8603-4a0e-bcde-29dc897f8e1f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078783 Mar 08 13:31:27.466109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1022/1855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:27 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:27.470658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4afdb10-ac03-4729-ba06-946d176cc907 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:27.471532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4afdb10-ac03-4729-ba06-946d176cc907 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:27.477932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4afdb10-ac03-4729-ba06-946d176cc907 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:27.478390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4afdb10-ac03-4729-ba06-946d176cc907 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:27.479178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4afdb10-ac03-4729-ba06-946d176cc907 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:27.479612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4afdb10-ac03-4729-ba06-946d176cc907 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:27.508062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4afdb10-ac03-4729-ba06-946d176cc907 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040927 Mar 08 13:31:27.508557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1023/1856] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:28.482285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:28.482939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:28.489152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:28.489600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:28.490369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:28.491372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:28.549712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:28.557450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-af4d9e61-6357-48d3-b02e-52fdd5c80145 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079051 Mar 08 13:31:28.558020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1024/1857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:28.562602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58de79c9-6d57-4d5a-a940-5da2caa276fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:28.563491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58de79c9-6d57-4d5a-a940-5da2caa276fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:28.569639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58de79c9-6d57-4d5a-a940-5da2caa276fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:28.570178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58de79c9-6d57-4d5a-a940-5da2caa276fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:28.570940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58de79c9-6d57-4d5a-a940-5da2caa276fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:28.571378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58de79c9-6d57-4d5a-a940-5da2caa276fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:28.598778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58de79c9-6d57-4d5a-a940-5da2caa276fe tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039774 Mar 08 13:31:28.599317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1025/1858] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:29.575273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:29.575990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:29.582642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:29.583085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:29.583848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:29.584425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:29.643421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:29.650668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f5f02055-44c3-4e00-942a-2488c0c33515 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080244 Mar 08 13:31:29.651224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1026/1859] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:29 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:29.655753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7e0366df-60ed-44d9-96fe-03fdf5d685a8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:29.656621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7e0366df-60ed-44d9-96fe-03fdf5d685a8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:29.662028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e0366df-60ed-44d9-96fe-03fdf5d685a8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:29.663018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e0366df-60ed-44d9-96fe-03fdf5d685a8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:29.663830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e0366df-60ed-44d9-96fe-03fdf5d685a8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:29.664260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e0366df-60ed-44d9-96fe-03fdf5d685a8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:29.691750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7e0366df-60ed-44d9-96fe-03fdf5d685a8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039572 Mar 08 13:31:29.692282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1027/1860] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:29 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:30.667618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:30.668289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:30.674500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:30.674940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:30.675691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:30.676124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:30.738846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:30.747568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2e712b7c-a9d7-43b0-9c64-fb6a5f0d61e0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084030 Mar 08 13:31:30.748221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1028/1861] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:30.753574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eeccae9a-8813-48a2-babd-2a56e4e44f48 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:30.754539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eeccae9a-8813-48a2-babd-2a56e4e44f48 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:30.761693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeccae9a-8813-48a2-babd-2a56e4e44f48 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:30.762276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeccae9a-8813-48a2-babd-2a56e4e44f48 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:30.763114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeccae9a-8813-48a2-babd-2a56e4e44f48 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:30.763548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeccae9a-8813-48a2-babd-2a56e4e44f48 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:30.794751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eeccae9a-8813-48a2-babd-2a56e4e44f48 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045467 Mar 08 13:31:30.795299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1029/1862] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:31.765332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:31.765983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:31.772483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:31.772963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:31.773737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:31.774171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:31.832094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:31:31.839535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a83ce050-9442-425e-83ec-7e294719d2d9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077978 Mar 08 13:31:31.840108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1030/1863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:31:31 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:31:31.844553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2fee7262-728d-4e85-b948-615c4d792f08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:31.845460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2fee7262-728d-4e85-b948-615c4d792f08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:31.851336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fee7262-728d-4e85-b948-615c4d792f08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:31.851778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fee7262-728d-4e85-b948-615c4d792f08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:31.852531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fee7262-728d-4e85-b948-615c4d792f08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:31.852994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fee7262-728d-4e85-b948-615c4d792f08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:31.880630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2fee7262-728d-4e85-b948-615c4d792f08 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039562 Mar 08 13:31:31.881258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1031/1864] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:31:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:31:32.946417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:31:32.947015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:31:32.952631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:32.953109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:31:32.953864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:31:32.954291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:22.677490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:32:22.678198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:32:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:32:33.639002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e972b4e2-7117-4766-92e6-c67fa2802d08) Mar 08 13:32:33.639614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e972b4e2-7117-4766-92e6-c67fa2802d08) {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:32:33.640544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0f08de31-c065-4dd2-9b2c-cb2a83bde5ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e" status: 400 len: 269 microversion: 2.1 time: 120.402019 Mar 08 13:32:33.642453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 834/1865] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:30:33 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e => generated 269 bytes in 120404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:32:33.655507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:33.656382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:33.662389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:33.662924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:33.663697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:33.664714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:33.727981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:33.735376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-99d9c346-5e36-4e54-bed4-b278a2cad47d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.084306 Mar 08 13:32:33.735946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 835/1866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:33 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:32:33.740533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-00343931-cd4e-4b05-b5a1-eb15271d04d1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:33.741493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-00343931-cd4e-4b05-b5a1-eb15271d04d1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:33.747911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00343931-cd4e-4b05-b5a1-eb15271d04d1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:33.748364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00343931-cd4e-4b05-b5a1-eb15271d04d1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:33.749164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00343931-cd4e-4b05-b5a1-eb15271d04d1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:33.749606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00343931-cd4e-4b05-b5a1-eb15271d04d1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:33.779442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-00343931-cd4e-4b05-b5a1-eb15271d04d1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042469 Mar 08 13:32:33.780004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 836/1867] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:33 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:33.784580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:33.785264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:33.791481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:33.791936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:33.792734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:33.793188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:33.811818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid 3bb7cf51-102c-4301-941a-338b211f4ddb {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:32:40.599870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid 3bb7cf51-102c-4301-941a-338b211f4ddb {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:32:40.626667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54640fb4-51da-4784-a839-fd18e4e0bca2) Mar 08 13:32:40.627286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54640fb4-51da-4784-a839-fd18e4e0bca2) {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:32:40.628170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-28cb9045-d13b-43f1-af4e-e27ae721bfc3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e" status: 400 len: 269 microversion: 2.1 time: 67.872603 Mar 08 13:32:40.628760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1032/1868] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:31:32 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e => generated 269 bytes in 67874 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 13:32:40.636697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:40.637417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:40.643238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:40.643691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:40.644652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:40.645117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:40.715569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:40.723013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-281175b4-7be7-4df1-a439-b8c3264f0a2c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.093303 Mar 08 13:32:40.723592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1033/1869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:40 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:32:40.728974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5e37f1c0-0d8c-4428-a707-987a6e90d1ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:40.729928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5e37f1c0-0d8c-4428-a707-987a6e90d1ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:40.735564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e37f1c0-0d8c-4428-a707-987a6e90d1ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:40.736025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e37f1c0-0d8c-4428-a707-987a6e90d1ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:40.736821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e37f1c0-0d8c-4428-a707-987a6e90d1ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:40.737267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e37f1c0-0d8c-4428-a707-987a6e90d1ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:40.767624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5e37f1c0-0d8c-4428-a707-987a6e90d1ee tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042993 Mar 08 13:32:40.768183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1034/1870] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:40 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:41.739377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:41.740024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:41.747104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:41.747550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:41.748319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:41.748780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:41.806778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:41.813986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f55be905-f02d-4996-9019-a3121aff966a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078479 Mar 08 13:32:41.814547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1035/1871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:32:41.819016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f9dc1103-c635-4d3a-9a3f-bfb5c164bf8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:41.819956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f9dc1103-c635-4d3a-9a3f-bfb5c164bf8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:41.825582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9dc1103-c635-4d3a-9a3f-bfb5c164bf8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:41.826030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9dc1103-c635-4d3a-9a3f-bfb5c164bf8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:41.826817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9dc1103-c635-4d3a-9a3f-bfb5c164bf8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:41.827259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9dc1103-c635-4d3a-9a3f-bfb5c164bf8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:41.856032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f9dc1103-c635-4d3a-9a3f-bfb5c164bf8c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040478 Mar 08 13:32:41.856586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1036/1872] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:41 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:42.830721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:42.831373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:42.838112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:42.838576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:42.839371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:42.839808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:42.898833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:42.906304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f1156c27-ce6b-4f0a-84e9-842a1bd9b538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079479 Mar 08 13:32:42.906878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1037/1873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:42.911461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-99d2a814-c8a9-4316-bd7a-51da0143ea1e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:42.912358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-99d2a814-c8a9-4316-bd7a-51da0143ea1e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:42.919258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99d2a814-c8a9-4316-bd7a-51da0143ea1e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:42.919709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99d2a814-c8a9-4316-bd7a-51da0143ea1e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:42.920503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99d2a814-c8a9-4316-bd7a-51da0143ea1e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:42.920983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-99d2a814-c8a9-4316-bd7a-51da0143ea1e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:42.949544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-99d2a814-c8a9-4316-bd7a-51da0143ea1e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041671 Mar 08 13:32:42.950085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1038/1874] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:42 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:43.924184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:43.924849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:43.931717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:43.932169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:43.932956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:43.933398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:43.996120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:44.003549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-da73cdde-383d-4768-ac4a-270adf630577 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083226 Mar 08 13:32:44.004111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1039/1875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:43 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:44.008924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-794d82d5-8d3b-4031-839d-c1cd415d4933 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:44.009822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-794d82d5-8d3b-4031-839d-c1cd415d4933 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:44.015451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-794d82d5-8d3b-4031-839d-c1cd415d4933 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:44.015902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-794d82d5-8d3b-4031-839d-c1cd415d4933 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:44.016675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-794d82d5-8d3b-4031-839d-c1cd415d4933 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:44.017120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-794d82d5-8d3b-4031-839d-c1cd415d4933 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:44.046000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-794d82d5-8d3b-4031-839d-c1cd415d4933 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040873 Mar 08 13:32:44.046550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1040/1876] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:45.020683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:45.021356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:45.027328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:45.027773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:45.028536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:45.028997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:45.088231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:45.095510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f9b57a28-5f7a-43f6-b0a0-54419b6cdb21 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078715 Mar 08 13:32:45.096071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1041/1877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:45 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:45.100510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c2e47bcd-e10c-492f-b219-ae862d8082de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:45.101576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c2e47bcd-e10c-492f-b219-ae862d8082de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:45.106898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2e47bcd-e10c-492f-b219-ae862d8082de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:45.107350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2e47bcd-e10c-492f-b219-ae862d8082de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:45.108115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2e47bcd-e10c-492f-b219-ae862d8082de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:45.108549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2e47bcd-e10c-492f-b219-ae862d8082de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:45.137144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c2e47bcd-e10c-492f-b219-ae862d8082de tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040071 Mar 08 13:32:45.137681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1042/1878] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:45 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:46.112075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:46.112766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:46.119349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:46.119800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:46.120559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:46.121062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:46.179103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:46.186491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-03c6fd50-91ad-4f01-b2b4-4e9dff29c2a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078191 Mar 08 13:32:46.187052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1043/1879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:46 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:46.191521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d7179485-1416-4147-a7f9-e8ad57918671 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:46.192410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d7179485-1416-4147-a7f9-e8ad57918671 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:46.198614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7179485-1416-4147-a7f9-e8ad57918671 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:46.199060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7179485-1416-4147-a7f9-e8ad57918671 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:46.199834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7179485-1416-4147-a7f9-e8ad57918671 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:46.200248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7179485-1416-4147-a7f9-e8ad57918671 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:46.228308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d7179485-1416-4147-a7f9-e8ad57918671 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040295 Mar 08 13:32:46.228880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1044/1880] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:46 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:47.203255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:47.203849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:47.210673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:47.211116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:47.211864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:47.212292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:47.271023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:47.279293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e480dd23-7721-4c17-80ae-1786461bb33e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079818 Mar 08 13:32:47.279858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1045/1881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:47 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:47.284390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a6fe1a1-174a-4b37-89a6-322136329c41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:47.285294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a6fe1a1-174a-4b37-89a6-322136329c41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:47.291154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a6fe1a1-174a-4b37-89a6-322136329c41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:47.291637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a6fe1a1-174a-4b37-89a6-322136329c41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:47.292403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a6fe1a1-174a-4b37-89a6-322136329c41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:47.292887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a6fe1a1-174a-4b37-89a6-322136329c41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:47.322188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a6fe1a1-174a-4b37-89a6-322136329c41 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041298 Mar 08 13:32:47.323017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1046/1882] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:47 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:48.296367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:48.297132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:48.303175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:48.304251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:48.310391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:48.310391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:48.365263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:48.373620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-12f4c6f4-2bcb-4a64-91d1-ea766de93de3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081049 Mar 08 13:32:48.374178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1047/1883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:48 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:48.378717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dec164f5-1a0d-416e-ab83-272457397dc4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:48.379663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dec164f5-1a0d-416e-ab83-272457397dc4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:48.385473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec164f5-1a0d-416e-ab83-272457397dc4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:48.385926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec164f5-1a0d-416e-ab83-272457397dc4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:48.386675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec164f5-1a0d-416e-ab83-272457397dc4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:48.387104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec164f5-1a0d-416e-ab83-272457397dc4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:48.414710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dec164f5-1a0d-416e-ab83-272457397dc4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039571 Mar 08 13:32:48.415249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1048/1884] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:48 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:49.390787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:49.391402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:49.397836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:49.398284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:49.399045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:49.399484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:49.459193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:49.466851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cd7b4b4e-64fd-4022-a0e6-e2399274e0e7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079950 Mar 08 13:32:49.467339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1049/1885] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:49 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:49.471939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-00afbbb1-a66f-47dd-bf6f-2c817a6c2ce7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:49.472858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-00afbbb1-a66f-47dd-bf6f-2c817a6c2ce7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:49.478209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00afbbb1-a66f-47dd-bf6f-2c817a6c2ce7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:49.478661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00afbbb1-a66f-47dd-bf6f-2c817a6c2ce7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:49.479417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00afbbb1-a66f-47dd-bf6f-2c817a6c2ce7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:49.479852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-00afbbb1-a66f-47dd-bf6f-2c817a6c2ce7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:49.508690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-00afbbb1-a66f-47dd-bf6f-2c817a6c2ce7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040341 Mar 08 13:32:49.509223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1050/1886] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:49 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:50.483914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:50.484581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:50.490665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:50.491898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:50.492771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:50.493204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:50.555593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:50.562872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a7b84524-02a0-4892-9d13-b079ad0b308e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082897 Mar 08 13:32:50.563437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1051/1887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:50 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:32:50.568002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-86717b10-536c-422f-8005-a614ea0d9d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:50.568914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-86717b10-536c-422f-8005-a614ea0d9d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:50.574652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86717b10-536c-422f-8005-a614ea0d9d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:50.575107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86717b10-536c-422f-8005-a614ea0d9d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:50.575865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86717b10-536c-422f-8005-a614ea0d9d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:50.576304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86717b10-536c-422f-8005-a614ea0d9d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:50.605237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-86717b10-536c-422f-8005-a614ea0d9d32 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040797 Mar 08 13:32:50.605789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1052/1888] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:50 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:51.578986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:51.579644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:51.586492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:51.586939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:51.587698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:51.588135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:51.646163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:51.653904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-972423ef-e04f-4e90-abe6-ce9489aaf84f tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078767 Mar 08 13:32:51.654505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1053/1889] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:51 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:51.658969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-44d23f3a-58a2-4c4a-98cb-ff8ccc28909c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:51.659855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-44d23f3a-58a2-4c4a-98cb-ff8ccc28909c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:51.665899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44d23f3a-58a2-4c4a-98cb-ff8ccc28909c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:51.666351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44d23f3a-58a2-4c4a-98cb-ff8ccc28909c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:51.667110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44d23f3a-58a2-4c4a-98cb-ff8ccc28909c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:51.667544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44d23f3a-58a2-4c4a-98cb-ff8ccc28909c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:51.694949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-44d23f3a-58a2-4c4a-98cb-ff8ccc28909c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039469 Mar 08 13:32:51.695494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1054/1890] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:51 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:52.669993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:52.670665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:52.676881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:52.677327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:52.678079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:52.678549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:52.737823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:52.745563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a1661adf-7e11-4070-862c-8514858cfd3a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079390 Mar 08 13:32:52.746137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1055/1891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:52 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:52.750724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7b3d6dd4-05cb-4534-9f9b-82511bfc081f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:52.751647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7b3d6dd4-05cb-4534-9f9b-82511bfc081f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:52.758076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b3d6dd4-05cb-4534-9f9b-82511bfc081f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:52.758707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b3d6dd4-05cb-4534-9f9b-82511bfc081f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:52.763554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b3d6dd4-05cb-4534-9f9b-82511bfc081f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:52.763554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b3d6dd4-05cb-4534-9f9b-82511bfc081f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:52.792758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7b3d6dd4-05cb-4534-9f9b-82511bfc081f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045575 Mar 08 13:32:52.797537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1056/1892] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:52 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:53.761912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:53.762575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:53.768827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:53.769280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:53.770037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:53.770469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:53.829477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:53.837342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8d88fe75-7873-4392-ab3c-b4231734f86a tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079265 Mar 08 13:32:53.837894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1057/1893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:53 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:53.842353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0e83390-a89d-4098-9d86-09eb0e4013ef tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:53.843243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0e83390-a89d-4098-9d86-09eb0e4013ef tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:53.848489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e83390-a89d-4098-9d86-09eb0e4013ef tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:53.848974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e83390-a89d-4098-9d86-09eb0e4013ef tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:53.849730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e83390-a89d-4098-9d86-09eb0e4013ef tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:53.850217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e83390-a89d-4098-9d86-09eb0e4013ef tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:53.878292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0e83390-a89d-4098-9d86-09eb0e4013ef tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039422 Mar 08 13:32:53.878824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1058/1894] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:53 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:54.853699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:54.854373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:54.860536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:54.861016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:54.861778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:54.862216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:54.920720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:54.927807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-92e87551-ea9d-4272-955e-3d6d5cdb97ab tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077977 Mar 08 13:32:54.929029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1059/1895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:54 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:54.933449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6a2bb1a5-a3bb-41f5-b162-2cb117daade8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:54.934327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6a2bb1a5-a3bb-41f5-b162-2cb117daade8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:54.939573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a2bb1a5-a3bb-41f5-b162-2cb117daade8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:54.940018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a2bb1a5-a3bb-41f5-b162-2cb117daade8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:54.940800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a2bb1a5-a3bb-41f5-b162-2cb117daade8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:54.941228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a2bb1a5-a3bb-41f5-b162-2cb117daade8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:54.969354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6a2bb1a5-a3bb-41f5-b162-2cb117daade8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039307 Mar 08 13:32:54.969911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1060/1896] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:54 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:55.950224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:55.951110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:55.957250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:55.957697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:55.958448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:55.958879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:56.018085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:56.027317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bcf6135a-0b30-4e8a-b325-66ccc6f218a7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.085681 Mar 08 13:32:56.027848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1061/1897] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:55 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:56.032319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b35a92ad-a189-4864-a9a3-49c3aa586a4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:56.033236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b35a92ad-a189-4864-a9a3-49c3aa586a4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:56.038674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b35a92ad-a189-4864-a9a3-49c3aa586a4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:56.039163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b35a92ad-a189-4864-a9a3-49c3aa586a4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:56.039920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b35a92ad-a189-4864-a9a3-49c3aa586a4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:56.040358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b35a92ad-a189-4864-a9a3-49c3aa586a4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:56.068103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b35a92ad-a189-4864-a9a3-49c3aa586a4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039295 Mar 08 13:32:56.068640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1062/1898] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:56 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:57.044049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:57.044728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:57.050914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:57.051364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:57.052119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:57.052558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:57.115105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:57.122767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d4bba2cb-b7a7-4f6e-9882-c6ff8aeb11f9 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082527 Mar 08 13:32:57.123326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1063/1899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:57 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:57.127798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5358b809-ab12-4e07-ba13-21fd95136db3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:57.128709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5358b809-ab12-4e07-ba13-21fd95136db3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:57.134636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358b809-ab12-4e07-ba13-21fd95136db3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:57.135083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358b809-ab12-4e07-ba13-21fd95136db3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:57.135848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358b809-ab12-4e07-ba13-21fd95136db3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:57.136293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5358b809-ab12-4e07-ba13-21fd95136db3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:57.165200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5358b809-ab12-4e07-ba13-21fd95136db3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040889 Mar 08 13:32:57.165755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1064/1900] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:57 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:58.139320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:58.140080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:58.146566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:58.147580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:58.148356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:58.148819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:58.210587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:58.218705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6f8f5c61-1784-4de8-b865-ee3025280fdd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083218 Mar 08 13:32:58.228292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1065/1901] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:58 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:32:58.233270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2c4b7978-dfab-47b5-91d0-61427cc9f0ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:58.234168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2c4b7978-dfab-47b5-91d0-61427cc9f0ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:58.239999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c4b7978-dfab-47b5-91d0-61427cc9f0ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:58.240448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c4b7978-dfab-47b5-91d0-61427cc9f0ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:58.241464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c4b7978-dfab-47b5-91d0-61427cc9f0ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:58.241898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c4b7978-dfab-47b5-91d0-61427cc9f0ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:58.277223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2c4b7978-dfab-47b5-91d0-61427cc9f0ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047598 Mar 08 13:32:58.281162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1066/1902] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:58 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:32:59.235304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:59.235923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:59.242466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:59.242924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:59.243965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:59.244385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:59.305150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:32:59.312396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2f32ce3f-1fa0-4ac5-a70d-049dad43b490 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080971 Mar 08 13:32:59.312986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1067/1903] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:32:59 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:32:59.320548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2d0767d1-25bd-41fb-8716-aa7efdeebcea tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:32:59.320548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2d0767d1-25bd-41fb-8716-aa7efdeebcea tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:32:59.324840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d0767d1-25bd-41fb-8716-aa7efdeebcea tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:59.325291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d0767d1-25bd-41fb-8716-aa7efdeebcea tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:59.326066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d0767d1-25bd-41fb-8716-aa7efdeebcea tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:32:59.326500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d0767d1-25bd-41fb-8716-aa7efdeebcea tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:32:59.356194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2d0767d1-25bd-41fb-8716-aa7efdeebcea tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042135 Mar 08 13:32:59.356780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1068/1904] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:32:59 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:00.328584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:00.329247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:00.335685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:00.336137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:00.336931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:00.337372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:00.396215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:00.403661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-55293b6c-e26b-410f-bfa2-46084bed3829 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078930 Mar 08 13:33:00.404217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1069/1905] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:00 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:00.408881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3196548c-f090-417c-ad9e-8dbf30b3cee3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:00.409722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3196548c-f090-417c-ad9e-8dbf30b3cee3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:00.416075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3196548c-f090-417c-ad9e-8dbf30b3cee3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:00.416522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3196548c-f090-417c-ad9e-8dbf30b3cee3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:00.417320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3196548c-f090-417c-ad9e-8dbf30b3cee3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:00.417756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3196548c-f090-417c-ad9e-8dbf30b3cee3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:00.453854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3196548c-f090-417c-ad9e-8dbf30b3cee3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048501 Mar 08 13:33:00.454335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1070/1906] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:00 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:01.420857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:01.421504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:01.427760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:01.428790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:01.429563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:01.430002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:01.488995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:01.497325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2e0d4acd-b11e-4392-aaf7-9d51c80ae804 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080384 Mar 08 13:33:01.497922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1071/1907] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:01 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:01.502561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-585676a7-1c4c-4efb-a887-8620b2d90518 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:01.503467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-585676a7-1c4c-4efb-a887-8620b2d90518 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:01.509760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585676a7-1c4c-4efb-a887-8620b2d90518 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:01.510212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585676a7-1c4c-4efb-a887-8620b2d90518 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:01.510975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585676a7-1c4c-4efb-a887-8620b2d90518 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:01.511414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-585676a7-1c4c-4efb-a887-8620b2d90518 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:01.539395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-585676a7-1c4c-4efb-a887-8620b2d90518 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040481 Mar 08 13:33:01.539946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1072/1908] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:01 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:02.514006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:02.514643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:02.520830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:02.521283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:02.522628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:02.523080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:02.581849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:02.590105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-01e0c248-f904-4764-857c-caa4a991fe58 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080005 Mar 08 13:33:02.590671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1073/1909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:02 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:02.595143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3bd5acaf-3e1f-4865-857c-9a1d919002f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:02.596019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3bd5acaf-3e1f-4865-857c-9a1d919002f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:02.601724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bd5acaf-3e1f-4865-857c-9a1d919002f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:02.602169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bd5acaf-3e1f-4865-857c-9a1d919002f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:02.602917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bd5acaf-3e1f-4865-857c-9a1d919002f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:02.603347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3bd5acaf-3e1f-4865-857c-9a1d919002f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:02.633787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3bd5acaf-3e1f-4865-857c-9a1d919002f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041989 Mar 08 13:33:02.634359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1074/1910] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:02 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:03.607001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:03.607660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:03.614031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:03.614479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:03.615245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:03.615713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:03.677907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:03.685242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1695ddfb-c6a2-4fe9-a79d-04e2fb20748e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082264 Mar 08 13:33:03.685809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1075/1911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:03 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:03.690450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d5060571-a3dd-4ea6-9d7f-69d126df8f8b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:03.691352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d5060571-a3dd-4ea6-9d7f-69d126df8f8b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:03.696944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5060571-a3dd-4ea6-9d7f-69d126df8f8b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:03.697393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5060571-a3dd-4ea6-9d7f-69d126df8f8b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:03.698147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5060571-a3dd-4ea6-9d7f-69d126df8f8b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:03.698584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5060571-a3dd-4ea6-9d7f-69d126df8f8b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:03.727046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d5060571-a3dd-4ea6-9d7f-69d126df8f8b tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040187 Mar 08 13:33:03.727588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1076/1912] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:03 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:04.701124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:04.701774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:04.708043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:04.708499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:04.709927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:04.710368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:04.768614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:04.776498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a2bd0c65-8d10-4759-9911-3133391c978e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079218 Mar 08 13:33:04.777089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1077/1913] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:04 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:04.781536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dba5a191-37cf-4c3c-a29c-ff0e5bcdf56e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:04.782420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dba5a191-37cf-4c3c-a29c-ff0e5bcdf56e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:04.787756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba5a191-37cf-4c3c-a29c-ff0e5bcdf56e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:04.788200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba5a191-37cf-4c3c-a29c-ff0e5bcdf56e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:04.789061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba5a191-37cf-4c3c-a29c-ff0e5bcdf56e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:04.789501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dba5a191-37cf-4c3c-a29c-ff0e5bcdf56e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:04.816626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dba5a191-37cf-4c3c-a29c-ff0e5bcdf56e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.038566 Mar 08 13:33:04.817188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1078/1914] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:04 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:05.793006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:05.793678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:05.799886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:05.800341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:05.801135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:05.801579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:05.859994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:05.867874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4b148a08-f2c4-45e6-a722-1ae6cb777538 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078652 Mar 08 13:33:05.868717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1079/1915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:05 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:05.873190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-93bbb542-3247-4f53-bb06-9a84fc81fcf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:05.874077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-93bbb542-3247-4f53-bb06-9a84fc81fcf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:05.879457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bbb542-3247-4f53-bb06-9a84fc81fcf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:05.879915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bbb542-3247-4f53-bb06-9a84fc81fcf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:05.880696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bbb542-3247-4f53-bb06-9a84fc81fcf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:05.881705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93bbb542-3247-4f53-bb06-9a84fc81fcf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:05.909527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-93bbb542-3247-4f53-bb06-9a84fc81fcf7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039814 Mar 08 13:33:05.910070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1080/1916] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:05 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:06.885669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:06.886360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:06.892637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:06.893113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:06.893881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:06.894316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:06.953821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:06.961112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3512940f-54ea-4191-a44a-a714b2aeaeae tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079906 Mar 08 13:33:06.961671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1081/1917] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:06 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:06.966126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f816292f-bf36-4720-8c1b-3ab74f4c3822 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:06.967011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f816292f-bf36-4720-8c1b-3ab74f4c3822 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:06.972506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f816292f-bf36-4720-8c1b-3ab74f4c3822 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:06.975157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f816292f-bf36-4720-8c1b-3ab74f4c3822 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:06.975157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f816292f-bf36-4720-8c1b-3ab74f4c3822 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:06.975157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f816292f-bf36-4720-8c1b-3ab74f4c3822 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:07.003262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f816292f-bf36-4720-8c1b-3ab74f4c3822 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040605 Mar 08 13:33:07.003805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1082/1918] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:06 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:07.978679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:07.979353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:07.985648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:07.986096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:07.986855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:07.987398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:08.045733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:08.053736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7bfda27b-e4cb-4b3b-bbf8-e2b88242ce45 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079727 Mar 08 13:33:08.054294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1083/1919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:07 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:08.058957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bf53d44b-37a0-412e-a407-ace3bd877cc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:08.059850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bf53d44b-37a0-412e-a407-ace3bd877cc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:08.065623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf53d44b-37a0-412e-a407-ace3bd877cc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:08.066070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf53d44b-37a0-412e-a407-ace3bd877cc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:08.066854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf53d44b-37a0-412e-a407-ace3bd877cc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:08.067286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf53d44b-37a0-412e-a407-ace3bd877cc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:08.095587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bf53d44b-37a0-412e-a407-ace3bd877cc0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040308 Mar 08 13:33:08.096130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1084/1920] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:08 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:09.070540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:09.071218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:09.077416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:09.077896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:09.078645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:09.079073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:09.137391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:09.144474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0ff2756-4091-42bc-ab8d-ed755f21116d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077840 Mar 08 13:33:09.145131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1085/1921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:09 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:09.150265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8a71e969-2fca-4a99-b563-6add5fba7b80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:09.151137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8a71e969-2fca-4a99-b563-6add5fba7b80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:09.156511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a71e969-2fca-4a99-b563-6add5fba7b80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:09.156988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a71e969-2fca-4a99-b563-6add5fba7b80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:09.157735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a71e969-2fca-4a99-b563-6add5fba7b80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:09.158169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8a71e969-2fca-4a99-b563-6add5fba7b80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:09.186601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8a71e969-2fca-4a99-b563-6add5fba7b80 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040485 Mar 08 13:33:09.187144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1086/1922] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:09 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:10.161798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:10.163179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:10.169275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:10.169731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:10.170496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:10.170937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:10.233003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:10.240908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b567ed43-3c60-4bf7-aa50-61c2dfe9c1a8 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.082336 Mar 08 13:33:10.241503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1087/1923] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:10 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:10.246192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-46c64808-bdea-4f73-a4a3-23868c9c348d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:10.247110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-46c64808-bdea-4f73-a4a3-23868c9c348d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:10.252598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46c64808-bdea-4f73-a4a3-23868c9c348d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:10.253066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46c64808-bdea-4f73-a4a3-23868c9c348d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:10.253816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46c64808-bdea-4f73-a4a3-23868c9c348d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:10.254244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-46c64808-bdea-4f73-a4a3-23868c9c348d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:10.281464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-46c64808-bdea-4f73-a4a3-23868c9c348d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039007 Mar 08 13:33:10.281995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1088/1924] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:10 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:11.258387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:11.259078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:11.265179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:11.265626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:11.266377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:11.266808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:11.330039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:11.337660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c589b1ab-0bde-4d04-91cc-944db5ab2319 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083749 Mar 08 13:33:11.338217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1089/1925] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:11 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:11.342761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5a65c254-1ca4-4108-a5e1-6858341ebaab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:11.345154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5a65c254-1ca4-4108-a5e1-6858341ebaab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:11.351287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a65c254-1ca4-4108-a5e1-6858341ebaab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:11.351739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a65c254-1ca4-4108-a5e1-6858341ebaab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:11.352538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a65c254-1ca4-4108-a5e1-6858341ebaab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:11.353008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a65c254-1ca4-4108-a5e1-6858341ebaab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:11.382003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5a65c254-1ca4-4108-a5e1-6858341ebaab tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042802 Mar 08 13:33:11.382547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1090/1926] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:11 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:12.354305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:12.354910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:12.361157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:12.361604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:12.362354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:12.362787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:12.422638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:12.430079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b2cab49e-a058-49de-b641-5aca9ebb12ea tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079639 Mar 08 13:33:12.430631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1091/1927] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:12 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:12.435126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-640c2d97-609a-4739-b225-b861ffd2b08a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:12.435947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-640c2d97-609a-4739-b225-b861ffd2b08a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:12.441588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-640c2d97-609a-4739-b225-b861ffd2b08a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:12.442033 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-640c2d97-609a-4739-b225-b861ffd2b08a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:12.442778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-640c2d97-609a-4739-b225-b861ffd2b08a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:12.443831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-640c2d97-609a-4739-b225-b861ffd2b08a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:12.472300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-640c2d97-609a-4739-b225-b861ffd2b08a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040660 Mar 08 13:33:12.472873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1092/1928] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:12 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:13.446447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:13.447100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:13.453382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:13.453831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:13.454584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:13.455020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:13.513646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:13.520872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5198b04d-391f-4b80-a124-d3a1536053a0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078977 Mar 08 13:33:13.521470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1093/1929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:13 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:13.525953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2ee19a9b-ee65-4365-9510-d7be24ae4e47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:13.526834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2ee19a9b-ee65-4365-9510-d7be24ae4e47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:13.532455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee19a9b-ee65-4365-9510-d7be24ae4e47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:13.532940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee19a9b-ee65-4365-9510-d7be24ae4e47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:13.533693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee19a9b-ee65-4365-9510-d7be24ae4e47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:13.534121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ee19a9b-ee65-4365-9510-d7be24ae4e47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:13.561867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2ee19a9b-ee65-4365-9510-d7be24ae4e47 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039392 Mar 08 13:33:13.562402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1094/1930] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:13 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:14.538219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:14.538865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:14.544970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:14.545417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:14.546175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:14.546605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:14.605156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:14.612473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dfaf0371-862b-4d31-b992-b6c4c7f9959b tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078868 Mar 08 13:33:14.613076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1095/1931] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:14 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:14.618679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e4e23957-c10b-4adb-aeb4-ae80ddd48bb3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:14.619624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e4e23957-c10b-4adb-aeb4-ae80ddd48bb3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:14.625147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4e23957-c10b-4adb-aeb4-ae80ddd48bb3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:14.625592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4e23957-c10b-4adb-aeb4-ae80ddd48bb3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:14.626344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4e23957-c10b-4adb-aeb4-ae80ddd48bb3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:14.626774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4e23957-c10b-4adb-aeb4-ae80ddd48bb3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:14.654795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e4e23957-c10b-4adb-aeb4-ae80ddd48bb3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040712 Mar 08 13:33:14.655343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1096/1932] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:14 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:15.630309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:15.631029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:15.636640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:15.637117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:15.637875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:15.638317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:15.698782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:15.706157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-405563f9-e3b5-48c1-892e-2af0d5ea8adf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.079795 Mar 08 13:33:15.706717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1097/1933] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:15 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:15.711891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-973732d9-d259-4c5f-825c-96b6536a4b7a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:15.712803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-973732d9-d259-4c5f-825c-96b6536a4b7a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:15.718216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973732d9-d259-4c5f-825c-96b6536a4b7a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:15.720444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973732d9-d259-4c5f-825c-96b6536a4b7a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:15.720444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973732d9-d259-4c5f-825c-96b6536a4b7a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:15.720444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-973732d9-d259-4c5f-825c-96b6536a4b7a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:15.748071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-973732d9-d259-4c5f-825c-96b6536a4b7a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040382 Mar 08 13:33:15.748616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1098/1934] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:15 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:16.723344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:16.724010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:16.730485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:16.730934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:16.731697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:16.732131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:16.794031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:16.801373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e289f307-54f2-4af6-860d-96f0be32c667 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081952 Mar 08 13:33:16.801935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1099/1935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:16 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:16.806765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6b77301c-dc21-4578-8938-4590d8e37669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:16.807647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6b77301c-dc21-4578-8938-4590d8e37669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:16.813164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b77301c-dc21-4578-8938-4590d8e37669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:16.813606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b77301c-dc21-4578-8938-4590d8e37669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:16.814394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b77301c-dc21-4578-8938-4590d8e37669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:16.814853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b77301c-dc21-4578-8938-4590d8e37669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:16.843809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6b77301c-dc21-4578-8938-4590d8e37669 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040592 Mar 08 13:33:16.844342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1100/1936] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:16 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:17.818528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:17.819235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:17.825486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:17.825934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:17.826693 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:17.827126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:17.887211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:17.894621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-73c941fe-f3ba-4062-84ac-73092bbc054e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080551 Mar 08 13:33:17.895179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1101/1937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:17 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:17.899833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fc621215-ce54-4b51-a960-edf68b6e9b6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:17.900729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fc621215-ce54-4b51-a960-edf68b6e9b6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:17.906258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc621215-ce54-4b51-a960-edf68b6e9b6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:17.906715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc621215-ce54-4b51-a960-edf68b6e9b6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:17.907449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc621215-ce54-4b51-a960-edf68b6e9b6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:17.907881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc621215-ce54-4b51-a960-edf68b6e9b6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:17.935622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fc621215-ce54-4b51-a960-edf68b6e9b6a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039441 Mar 08 13:33:17.936169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1102/1938] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:17 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:18.911366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:18.912201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:18.918217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:18.918668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:18.919433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:18.919866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:18.978952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:18.986212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7e280eae-08a7-4475-88c5-a58407e707bc tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078698 Mar 08 13:33:18.986771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1103/1939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:18 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:18.991886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f4151a0a-a9f3-46d0-bbf5-14c7d1ca56af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:18.993060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f4151a0a-a9f3-46d0-bbf5-14c7d1ca56af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:18.998499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f4151a0a-a9f3-46d0-bbf5-14c7d1ca56af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:18.998946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f4151a0a-a9f3-46d0-bbf5-14c7d1ca56af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:18.999705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f4151a0a-a9f3-46d0-bbf5-14c7d1ca56af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:19.000140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f4151a0a-a9f3-46d0-bbf5-14c7d1ca56af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:19.028546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f4151a0a-a9f3-46d0-bbf5-14c7d1ca56af tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040733 Mar 08 13:33:19.029067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1104/1940] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:18 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:20.003875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:20.004524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:20.011365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:20.011814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:20.012632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:20.013095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:20.073367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:20.080452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eddfab96-0e42-4ed4-8e87-304ac696f2fa tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080477 Mar 08 13:33:20.081041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1105/1941] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:19 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:20.085782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7bbc6f17-2749-4b4c-845a-57f931b2ddf6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:20.086664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7bbc6f17-2749-4b4c-845a-57f931b2ddf6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:20.091910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bbc6f17-2749-4b4c-845a-57f931b2ddf6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:20.092354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bbc6f17-2749-4b4c-845a-57f931b2ddf6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:20.093145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bbc6f17-2749-4b4c-845a-57f931b2ddf6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:20.093575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bbc6f17-2749-4b4c-845a-57f931b2ddf6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:20.121797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7bbc6f17-2749-4b4c-845a-57f931b2ddf6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039781 Mar 08 13:33:20.122336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1106/1942] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:20 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:21.097372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:21.098057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:21.104876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:21.105358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:21.106127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:21.106566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:21.165009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:21.172202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6f2b7f5b-e3b6-44b4-b476-f91484e67ba5 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078725 Mar 08 13:33:21.172863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1107/1943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:21 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:21.177346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a633c8df-6a62-4b24-bc55-8ff2b7832aaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:21.178229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a633c8df-6a62-4b24-bc55-8ff2b7832aaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:21.183556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a633c8df-6a62-4b24-bc55-8ff2b7832aaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:21.184011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a633c8df-6a62-4b24-bc55-8ff2b7832aaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:21.184807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a633c8df-6a62-4b24-bc55-8ff2b7832aaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:21.185276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a633c8df-6a62-4b24-bc55-8ff2b7832aaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:21.214293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a633c8df-6a62-4b24-bc55-8ff2b7832aaf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040442 Mar 08 13:33:21.214843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1108/1944] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:21 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:22.189450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:22.190174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:22.196482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:22.196971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:22.197731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:22.198167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:22.256412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:22.263679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40960702-c96c-4bac-8061-6f997bbba5b7 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078046 Mar 08 13:33:22.264231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1109/1945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:22 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:22.268677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c096a4da-59d0-4b6c-b6d9-ecf2324711aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:22.269552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c096a4da-59d0-4b6c-b6d9-ecf2324711aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:22.275771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c096a4da-59d0-4b6c-b6d9-ecf2324711aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:22.276220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c096a4da-59d0-4b6c-b6d9-ecf2324711aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:22.277021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c096a4da-59d0-4b6c-b6d9-ecf2324711aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:22.277458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c096a4da-59d0-4b6c-b6d9-ecf2324711aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:22.305133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c096a4da-59d0-4b6c-b6d9-ecf2324711aa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039869 Mar 08 13:33:22.305678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1110/1946] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:22 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:23.280829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:23.281506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:23.288251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:23.288719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:23.289489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:23.289914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:23.351461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:23.358824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4ad1654b-00f0-4a4d-96fd-45b6683362ba tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081860 Mar 08 13:33:23.359387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1111/1947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:23 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:23.363821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-086b52a4-d096-4184-8ae9-21aef3a86f82 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:23.365318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-086b52a4-d096-4184-8ae9-21aef3a86f82 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:23.371032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-086b52a4-d096-4184-8ae9-21aef3a86f82 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:23.371482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-086b52a4-d096-4184-8ae9-21aef3a86f82 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:23.372233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-086b52a4-d096-4184-8ae9-21aef3a86f82 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:23.372687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-086b52a4-d096-4184-8ae9-21aef3a86f82 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:23.404296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-086b52a4-d096-4184-8ae9-21aef3a86f82 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043901 Mar 08 13:33:23.404881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1112/1948] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:23 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:24.375498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:24.376129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:24.383183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:24.383629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:24.384387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:24.384852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:24.447527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:24.454848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d46bbf2a-98ec-42da-a3b4-3f5199263228 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083190 Mar 08 13:33:24.455415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1113/1949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:24 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:24.460065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a5446a4d-7fa7-4767-90af-306f54c65fa0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:24.460973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a5446a4d-7fa7-4767-90af-306f54c65fa0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:24.466432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5446a4d-7fa7-4767-90af-306f54c65fa0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:24.466880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5446a4d-7fa7-4767-90af-306f54c65fa0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:24.467635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5446a4d-7fa7-4767-90af-306f54c65fa0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:24.468070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a5446a4d-7fa7-4767-90af-306f54c65fa0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:24.496070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a5446a4d-7fa7-4767-90af-306f54c65fa0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039687 Mar 08 13:33:24.496608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1114/1950] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:24 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:25.471587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:25.472221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:25.478831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:25.479272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:25.480022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:25.480452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:25.541073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:25.548356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2c504d84-333e-4064-ae9d-1c3d37261181 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080904 Mar 08 13:33:25.548937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1115/1951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:25 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:25.553602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-53a47c5b-c116-4ded-8813-87845c239bd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:25.554483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-53a47c5b-c116-4ded-8813-87845c239bd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:25.559813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53a47c5b-c116-4ded-8813-87845c239bd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:25.560256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53a47c5b-c116-4ded-8813-87845c239bd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:25.561040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53a47c5b-c116-4ded-8813-87845c239bd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:25.561473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53a47c5b-c116-4ded-8813-87845c239bd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:25.589664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-53a47c5b-c116-4ded-8813-87845c239bd5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039719 Mar 08 13:33:25.590214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1116/1952] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:25 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:26.564688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:26.565329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:26.571988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:26.572444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:26.573223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:26.573656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:26.634247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:26.641568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-12aba67a-009d-4765-9503-6f588c431b4e tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080867 Mar 08 13:33:26.642129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1117/1953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:26 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:26.647104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-845a77a7-be3d-4c91-a20a-5b9abd344d86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:26.647965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-845a77a7-be3d-4c91-a20a-5b9abd344d86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:26.653389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-845a77a7-be3d-4c91-a20a-5b9abd344d86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:26.653838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-845a77a7-be3d-4c91-a20a-5b9abd344d86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:26.654592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-845a77a7-be3d-4c91-a20a-5b9abd344d86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:26.655025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-845a77a7-be3d-4c91-a20a-5b9abd344d86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:26.692237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-845a77a7-be3d-4c91-a20a-5b9abd344d86 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049055 Mar 08 13:33:26.692892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1118/1954] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:26 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:27.657892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:27.658533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:27.665532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:27.665976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:27.666727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:27.667163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:27.725019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:27.732300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-047353b7-22da-46c9-8871-dab3de473ed0 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078357 Mar 08 13:33:27.732893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1119/1955] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:27 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:27.737324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ad80b464-d8a4-48e9-a50d-608c6c5f97e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:27.738203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ad80b464-d8a4-48e9-a50d-608c6c5f97e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:27.744531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad80b464-d8a4-48e9-a50d-608c6c5f97e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:27.745016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad80b464-d8a4-48e9-a50d-608c6c5f97e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:27.745774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad80b464-d8a4-48e9-a50d-608c6c5f97e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:27.746206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad80b464-d8a4-48e9-a50d-608c6c5f97e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:27.773357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ad80b464-d8a4-48e9-a50d-608c6c5f97e3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039507 Mar 08 13:33:27.773885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1120/1956] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:27 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:28.749725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:28.750438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:28.757334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:28.757820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:28.758596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:28.759039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:28.819095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:28.826530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0548cef7-3db2-47fc-b761-b81cc9dd3daf tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080605 Mar 08 13:33:28.827101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1121/1957] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:28 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:28.831728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4a499354-2a55-4b6e-b9a0-4dadd436bacf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:28.832644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4a499354-2a55-4b6e-b9a0-4dadd436bacf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:28.838665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a499354-2a55-4b6e-b9a0-4dadd436bacf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:28.839116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a499354-2a55-4b6e-b9a0-4dadd436bacf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:28.839873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a499354-2a55-4b6e-b9a0-4dadd436bacf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:28.840308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4a499354-2a55-4b6e-b9a0-4dadd436bacf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:29.035784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4a499354-2a55-4b6e-b9a0-4dadd436bacf tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.207528 Mar 08 13:33:29.037362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1122/1958] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:28 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:33:29.843202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:29.843860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:29.850088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:29.850539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:29.851297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:29.851733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:29.913233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:29.920528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ed2a1e8b-bebc-400c-96ea-22f92f66a7a1 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.081157 Mar 08 13:33:29.921103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1123/1959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:29 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:30.048342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-152500db-8436-4c14-8dfa-9d1f64b592f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:30.049274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-152500db-8436-4c14-8dfa-9d1f64b592f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:30.055713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-152500db-8436-4c14-8dfa-9d1f64b592f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:30.056160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-152500db-8436-4c14-8dfa-9d1f64b592f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:30.056956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-152500db-8436-4c14-8dfa-9d1f64b592f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:30.057395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-152500db-8436-4c14-8dfa-9d1f64b592f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:30.084452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-152500db-8436-4c14-8dfa-9d1f64b592f6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039974 Mar 08 13:33:30.085006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1124/1960] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:30 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:33:30.937890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:30.938591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:30.945234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:30.945681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:30.946438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:30.946869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:31.005469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:31.012692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aedc89f1-c72b-4364-85a6-43bd33bbef02 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078615 Mar 08 13:33:31.013235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1125/1961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:30 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:31.096203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aa011b9b-78e6-44ba-a87a-9dcf92aa5ca5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:31.097139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aa011b9b-78e6-44ba-a87a-9dcf92aa5ca5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:31.103256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa011b9b-78e6-44ba-a87a-9dcf92aa5ca5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:31.103708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa011b9b-78e6-44ba-a87a-9dcf92aa5ca5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:31.104476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa011b9b-78e6-44ba-a87a-9dcf92aa5ca5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:31.104949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aa011b9b-78e6-44ba-a87a-9dcf92aa5ca5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:31.134219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aa011b9b-78e6-44ba-a87a-9dcf92aa5ca5 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041794 Mar 08 13:33:31.134761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1126/1962] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:31 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:33:32.029366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:32.030057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:32.036498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:32.036990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:32.037750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:32.038188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:32.096407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:33:32.103582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e622afff-5f33-4bcd-8408-5a18c10250ff tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078084 Mar 08 13:33:32.104135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1127/1963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:33:32 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:33:32.145431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-80e0ee60-9393-41a8-a630-8079e4a39074 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:32.146338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-80e0ee60-9393-41a8-a630-8079e4a39074 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:32.152020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80e0ee60-9393-41a8-a630-8079e4a39074 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:32.152476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80e0ee60-9393-41a8-a630-8079e4a39074 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:32.153278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80e0ee60-9393-41a8-a630-8079e4a39074 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:32.153722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80e0ee60-9393-41a8-a630-8079e4a39074 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:32.183661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-80e0ee60-9393-41a8-a630-8079e4a39074 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042041 Mar 08 13:33:32.184201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1128/1964] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:33:32 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 13:33:32.863994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:33:32.864491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:33:32.870674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:32.871127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:32.871893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:33:32.872331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:33:55.462976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:33:55.463608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:34:06.756986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:34:06.757602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:34:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:34:09.239082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:34:09.239863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:34:19.854519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:34:19.855163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e (ip 10.222.0.52) !!! Mar 08 13:34:34.023162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6fc4338e-0046-4578-87f4-681170b54706) Mar 08 13:34:34.023775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6fc4338e-0046-4578-87f4-681170b54706) {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:34:34.024615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f538d04d-922f-4705-8884-969edf8b5a1a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e" status: 400 len: 269 microversion: 2.1 time: 120.243724 Mar 08 13:34:34.025245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 837/1965] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:32:33 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e => generated 269 bytes in 120245 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:34:34.031287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:34.031896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:34.038854 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.039463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.040244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.040694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.108979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:34.116771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ce8a6bea-db9a-4feb-ae1f-2cd674228f5d tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.089516 Mar 08 13:34:34.119411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 838/1966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:34 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:34.196839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-95dbcf81-5e3c-496f-a1e2-41f48bd268d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:34.197797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-95dbcf81-5e3c-496f-a1e2-41f48bd268d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:34.203629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95dbcf81-5e3c-496f-a1e2-41f48bd268d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.204078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95dbcf81-5e3c-496f-a1e2-41f48bd268d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.204877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95dbcf81-5e3c-496f-a1e2-41f48bd268d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.205310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95dbcf81-5e3c-496f-a1e2-41f48bd268d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.234469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-95dbcf81-5e3c-496f-a1e2-41f48bd268d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116067 Mar 08 13:34:34.235024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 839/1967] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:34:34 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:34:34.240448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:34.240976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:34.247001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.247420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.248051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.248484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.380841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid 3bb7cf51-102c-4301-941a-338b211f4ddb {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:34:34.545007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid 3bb7cf51-102c-4301-941a-338b211f4ddb {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:34:34.571861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d8c83af-e68a-4121-bd74-d68f5d602d05) Mar 08 13:34:34.572691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9d8c83af-e68a-4121-bd74-d68f5d602d05) {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:34:34.573914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-23a5df7f-c8ab-42f2-ad96-2f9fde13165f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e" status: 400 len: 269 microversion: 2.1 time: 61.714003 Mar 08 13:34:34.574758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1129/1968] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:33:32 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e => generated 269 bytes in 61715 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 13:34:34.580783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:34.581392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:34.587796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.588250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.589067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.589502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.651749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:34.659035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77509069-8e2c-4fd3-be09-4c9a6e9489ad tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.083139 Mar 08 13:34:34.659584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1130/1969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:34 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:34.664797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-296ddd39-d546-46d4-862c-4c0b45653960 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:34.665680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-296ddd39-d546-46d4-862c-4c0b45653960 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:34.671413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-296ddd39-d546-46d4-862c-4c0b45653960 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.671858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-296ddd39-d546-46d4-862c-4c0b45653960 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.672604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-296ddd39-d546-46d4-862c-4c0b45653960 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.673060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-296ddd39-d546-46d4-862c-4c0b45653960 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.700946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-296ddd39-d546-46d4-862c-4c0b45653960 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040326 Mar 08 13:34:34.701471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1131/1970] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:34:34 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:34:34.705779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:34.708962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:34.712236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.712701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.713451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:34.713890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:34.737105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:34:35.075653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-79e74862-c69b-4e10-ad3d-5c2b73fb63e1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 204 len: 0 microversion: 2.1 time: 0.372912 Mar 08 13:34:35.076254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1132/1971] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:34:34 2022] DELETE /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:34:35.085267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:35.097926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:35.097926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:35.097926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:35.097926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:35.098440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:35.227741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:35.235674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40a2cbd2-41f4-4355-9ac7-36e0d9384659 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155035 Mar 08 13:34:35.236237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1133/1972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:35.676245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:35.676964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:35.683329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:35.683780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:35.684540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:35.685012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:35.743793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:35.751053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-57a213e0-8721-4dbb-bc08-202562235ee3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078673 Mar 08 13:34:35.751611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1134/1973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:35 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:35.756603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bfe5a97d-b48c-4e01-8287-f6dd667c8bdd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:35.762687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bfe5a97d-b48c-4e01-8287-f6dd667c8bdd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:35.763175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfe5a97d-b48c-4e01-8287-f6dd667c8bdd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:35.763624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfe5a97d-b48c-4e01-8287-f6dd667c8bdd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:35.764384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfe5a97d-b48c-4e01-8287-f6dd667c8bdd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:35.764849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfe5a97d-b48c-4e01-8287-f6dd667c8bdd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:35.793607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bfe5a97d-b48c-4e01-8287-f6dd667c8bdd tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041013 Mar 08 13:34:35.794146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1135/1974] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:34:35 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:34:36.253803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:36.254409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:36.260578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:36.261060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:36.261840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:36.262274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:36.394449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:36.402357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-34c91e44-e800-4b7c-9b51-8ac170489eb5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152403 Mar 08 13:34:36.402905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1136/1975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:36.768509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:36.769220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:36.775367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:36.775810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:36.776566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:36.777022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:36.835686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:36.843044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-650e2817-2a4a-4875-a96a-dc00ee03e168 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078406 Mar 08 13:34:36.843605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1137/1976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:36 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:36.848082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-745c0f87-5b13-4ee3-addc-4d0d595234fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:36.849104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-745c0f87-5b13-4ee3-addc-4d0d595234fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:36.854488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-745c0f87-5b13-4ee3-addc-4d0d595234fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:36.854940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-745c0f87-5b13-4ee3-addc-4d0d595234fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:36.855704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-745c0f87-5b13-4ee3-addc-4d0d595234fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:36.856150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-745c0f87-5b13-4ee3-addc-4d0d595234fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:36.885142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-745c0f87-5b13-4ee3-addc-4d0d595234fb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040509 Mar 08 13:34:36.885683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1138/1977] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:34:36 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:34:37.419506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:37.420111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:37.425919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:37.426362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:37.427737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:37.428175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:37.561731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:37.570153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eb8347ad-12f9-4b69-ab04-13f03129982e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154574 Mar 08 13:34:37.570707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1139/1978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:37.859881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:37.860553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:37.867579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:37.868023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:37.868800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:37.869233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:37.928735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:37.936091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e53b46ff-0377-4c27-9373-fa39dbae8e57 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.080111 Mar 08 13:34:37.936651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1140/1979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:37 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:37.941168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a95dc76-f1cc-4963-8f2d-d2375467d8eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:37.942053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a95dc76-f1cc-4963-8f2d-d2375467d8eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:37.947719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a95dc76-f1cc-4963-8f2d-d2375467d8eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:37.948174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a95dc76-f1cc-4963-8f2d-d2375467d8eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:37.948962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a95dc76-f1cc-4963-8f2d-d2375467d8eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:37.949405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a95dc76-f1cc-4963-8f2d-d2375467d8eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:37.977076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a95dc76-f1cc-4963-8f2d-d2375467d8eb tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039388 Mar 08 13:34:37.977616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1141/1980] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:34:37 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:34:38.588169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:38.588691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:38.594555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:38.595007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:38.595764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:38.596200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:38.729569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:38.737361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3d41a206-4b2b-435f-a5dc-df8a405df875 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153124 Mar 08 13:34:38.738130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1142/1981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:38.952722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:38.953365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:38.959648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:38.960098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:38.960890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:38.961331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:39.019460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:39.026736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4b492335-10cc-47a7-9740-7ed593b0f3f3 tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.077885 Mar 08 13:34:39.027320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1143/1982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:38 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:39.031811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6b140a10-de01-4534-a0c8-05622b847d4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:39.032717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6b140a10-de01-4534-a0c8-05622b847d4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:39.038153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b140a10-de01-4534-a0c8-05622b847d4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:39.038605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b140a10-de01-4534-a0c8-05622b847d4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:39.039360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b140a10-de01-4534-a0c8-05622b847d4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:39.039797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6b140a10-de01-4534-a0c8-05622b847d4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:39.068164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6b140a10-de01-4534-a0c8-05622b847d4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039320 Mar 08 13:34:39.068728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1144/1983] 10.222.0.52 () {60 vars in 1342 bytes} [Tue Mar 8 13:34:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:34:39.755083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:39.755696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:39.761582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:39.762031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:39.762790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:39.763234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:39.892801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:39.901058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8b2919a3-e72a-4e22-be2c-912c14f69028 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149936 Mar 08 13:34:39.901616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1145/1984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:40.043391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:40.044028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:40.050139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:40.050586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:40.051368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:40.051835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:40.110038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:40.117605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-106de0c4-66be-428a-a9f9-4fb00814f7af tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1226 microversion: 2.1 time: 0.078118 Mar 08 13:34:40.118157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1146/1985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:40 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:34:40.122572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:34:40.123451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:40.128803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:40.129251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:40.130603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:40.131138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:40.153055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 is not ready Mar 08 13:34:40.164073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 409 to user: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 is not ready {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:34:40.164073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c64d9359-7cf9-487e-8425-9c3538497fec tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/action" status: 409 len: 110 microversion: 2.20 time: 0.035372 Mar 08 13:34:40.164073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1147/1986] 10.222.0.52 () {62 vars in 1318 bytes} [Tue Mar 8 13:34:40 2022] POST /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127/action => generated 110 bytes in 36 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Mar 08 13:34:40.811241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97bda9a5-11fd-4065-9bd3-a7bfcc403e77) Mar 08 13:34:40.811846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-97bda9a5-11fd-4065-9bd3-a7bfcc403e77) {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:34:40.812905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4fa23843-7338-4fdb-88f3-867b2aeabc92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e" status: 400 len: 269 microversion: 2.1 time: 6.576951 Mar 08 13:34:40.817753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 840/1987] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:34:34 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb/os-volume_attachments/b8d953f8-136b-4374-b330-37498bda563e => generated 269 bytes in 6582 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:34:40.918321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:40.924380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:40.925375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:40.925837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:40.927366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:40.927851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:41.065458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:41.073301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-55406c54-aedc-48c9-8eb1-84980dd8dcb1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159129 Mar 08 13:34:41.073859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1148/1988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:41.136077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:41.136743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:41.142542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:41.142986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:41.143744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:41.144173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:41.172809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:41.173287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:41.173723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lazy-loading 'fault' on Instance uuid 0d4990fb-f02f-4297-a1c5-b1970d04c24c {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:34:41.216443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98c597d9e1a45e7bd8267b730a0b84b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fda171a20f4fe3b366624e9c26e12a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:41.224379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea3eee0a-1156-4a5b-b321-32bd04ef46dd tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 200 len: 1231 microversion: 2.1 time: 0.093455 Mar 08 13:34:41.224991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 841/1989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:41 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:42.090573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:42.091201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:42.097511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:42.097957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:42.098708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:42.099141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:42.231529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:42.240432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e9793237-0b8f-448c-a7a3-11754399eb7e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153589 Mar 08 13:34:42.241034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1149/1990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:42.242110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:42.242715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] [instance: 0d4990fb-f02f-4297-a1c5-b1970d04c24c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:42.248957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:42.249403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:42.250164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:42.250596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:42.263517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] HTTP exception thrown: Instance 0d4990fb-f02f-4297-a1c5-b1970d04c24c could not be found. Mar 08 13:34:42.264072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Returning 404 to user: Instance 0d4990fb-f02f-4297-a1c5-b1970d04c24c could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:34:42.264902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8c7ab84f-82fb-46f1-8404-ec5a47351ecb tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c" status: 404 len: 111 microversion: 2.1 time: 0.027451 Mar 08 13:34:42.265409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 842/1991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:42 2022] GET /compute/v2.1/servers/0d4990fb-f02f-4297-a1c5-b1970d04c24c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:34:43.257951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:43.258556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:43.264852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:43.265300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:43.266051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:43.266482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:43.405953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:43.414714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e3e53b31-d4d6-482e-8c80-00cd99e1d02b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.161254 Mar 08 13:34:43.415263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1150/1992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:44.431127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:44.431869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:44.438175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:44.438689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:44.439481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:44.439921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:44.573024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:44.580781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-be40e6b1-4000-4ac4-b2da-73f11620f8a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153432 Mar 08 13:34:44.581340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 843/1993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:45.599245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:45.599842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:45.605681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:45.606153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:45.606909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:45.607346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:45.744429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:45.752135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-596f84b7-25d6-4c32-aec5-846461b2e7d5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.157013 Mar 08 13:34:45.752707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1151/1994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:46.770282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:46.770940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:46.777337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:46.777653 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:46.778413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:46.778852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:46.911311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:46.919203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9192d75b-da62-4da6-a101-31bb51794f1b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152834 Mar 08 13:34:46.919759 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 844/1995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:47.936889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:47.937504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:47.944256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:47.944730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:47.945492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:47.945929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:48.072292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:48.080008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-531a3068-6229-42aa-adcb-382e0a46333e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.146975 Mar 08 13:34:48.080564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1152/1996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:49.097480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:49.098744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:49.105093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:49.105546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:49.106314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:49.106754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:49.237566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:49.246173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-210754d8-0f60-46cb-8fe9-cfc99a84facc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152581 Mar 08 13:34:49.246734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 845/1997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:50.263055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:50.263660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:50.270484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:50.270934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:50.271746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:50.272190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:50.409283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:50.417835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-455a6273-ad80-45e5-a75d-ee3de6b6a52e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158602 Mar 08 13:34:50.418403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1153/1998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:51.435374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:51.435978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:51.442589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:51.443031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:51.443807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:51.444219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:51.578484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:51.586725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e89a8ff3-4e06-415b-9c4c-6d138f52a758 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155220 Mar 08 13:34:51.587286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 846/1999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:52.603412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:52.604024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:52.610371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:52.610819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:52.611578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:52.612016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:52.744316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:52.752162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e766dda8-14e5-4016-9ec7-4a388405de31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152539 Mar 08 13:34:52.752750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1154/2000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:53.770438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:53.771025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:53.777536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:53.777982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:53.778742 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:53.779174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:53.912478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:53.920316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-25fb63b6-ab0a-499f-9888-401f3bc1ea42 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154399 Mar 08 13:34:53.920977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 847/2001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:54.938588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:54.939208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:54.946291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:54.946745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:54.947512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:54.947949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:55.085032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:55.092740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8c97823f-e8ad-437e-a937-a6a66e783939 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158048 Mar 08 13:34:55.093298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1155/2002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:56.110146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:56.110781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:56.118097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:56.118549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:56.119308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:56.119749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:56.256735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:56.264409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-26fa31ae-fcd0-4b17-9f44-a14dc9a856e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158135 Mar 08 13:34:56.265002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 848/2003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:57.281026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:57.281636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:57.288157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:57.288608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:57.289394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:57.289830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:57.425586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:57.434050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-34b5c15e-d3e8-4613-8f8d-8236b0b516eb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156785 Mar 08 13:34:57.434616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1156/2004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:58.452255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:58.452902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:58.459646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:58.460094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:58.460922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:58.461357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:58.591205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:58.600090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a26e46ca-4481-4adb-924a-7717d477eb18 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151550 Mar 08 13:34:58.600586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 849/2005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:34:59.617956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:34:59.618560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:34:59.624722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:59.625171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:59.625919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:34:59.626349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:34:59.757539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:34:59.765251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58f29201-a976-4554-9fc5-8de08e95646d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151920 Mar 08 13:34:59.765797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1157/2006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:34:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:35:00.782767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:00.783360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:00.790251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:00.790705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:00.791467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:00.791899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:00.931753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:00.939864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5797cbee-02f4-4a69-b954-fc8b3a757da8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160889 Mar 08 13:35:00.940424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 850/2007] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:01.958184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:01.958801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:01.965028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:01.965477 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:01.966453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:01.967060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:02.104682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:02.112533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-66d96ac4-4d96-4d31-9543-9a48068aeba6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158872 Mar 08 13:35:02.113749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1158/2008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:03.130678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:03.131284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:03.137213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:03.137656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:03.138995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:03.139379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:03.266557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:03.274635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6b91bb73-4c59-486f-9c32-e58da58fca2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148374 Mar 08 13:35:03.275196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 851/2009] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:04.291753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:04.292357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:04.298698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:04.299141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:04.299890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:04.300354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:04.429161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:04.436908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-78e069d3-cf02-42de-afe2-87dbd0a5f431 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148918 Mar 08 13:35:04.437655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1159/2010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:05.455051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:05.455660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:05.461900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:05.462351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:05.463114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:05.463557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:05.595370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:05.604194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0458c8be-0732-4b50-a501-301aed35d306 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152984 Mar 08 13:35:05.604712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 852/2011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:06.626961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:06.627514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:06.634697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:06.635147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:06.635913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:06.636430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:06.770571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:06.778393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cb101fd6-3fce-4719-b3d8-0b2e8ea2e94a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155696 Mar 08 13:35:06.778951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1160/2012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:07.795703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:07.796350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:07.803586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:07.804039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:07.804841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:07.805286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:07.936897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:07.944692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-104854f6-4237-42d6-89a5-11a10c09d318 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152824 Mar 08 13:35:07.945245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 853/2013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:08.962069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:08.962676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:08.968910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:08.969360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:08.970109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:08.970540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:09.100943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:09.108600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d7193b6-ddeb-4c26-ad98-44f7f00f0de2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150409 Mar 08 13:35:09.109179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1161/2014] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:35:10.126007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:10.126616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:10.132970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:10.133430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:10.134196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:10.134634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:10.266678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:10.274821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a81cde18-9634-45c9-ac6c-f96b3158fc6e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152711 Mar 08 13:35:10.275388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 854/2015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:11.292206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:11.292854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:11.299210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:11.299666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:11.300535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:11.300953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:11.443306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:11.451096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6bfb67a9-67a0-4bb4-903d-eda9e3119fe9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.162721 Mar 08 13:35:11.451657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1162/2016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:12.467700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:12.468381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:12.474619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:12.475064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:12.475824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:12.476259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:12.610077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:12.619129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1822a977-63af-4312-812c-6b0d121500fc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155232 Mar 08 13:35:12.619695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 855/2017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:13.636646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:13.637204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:13.643385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:13.643835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:13.644592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:13.645044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:13.774332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:13.782101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f35f2e13-f888-42b7-959a-3da3d6eb81f7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149287 Mar 08 13:35:13.782917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1163/2018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:14.799682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:14.800492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:14.806918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:14.807370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:14.808131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:14.808568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:14.942561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:14.950288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1ac419e2-e239-4e3d-a385-c72494777eeb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154577 Mar 08 13:35:14.950870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 856/2019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:15.967921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:15.968516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:15.974936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:15.975385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:15.976139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:15.976571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:16.105841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:16.114784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9137ab49-89fe-4b25-b6a9-e30a90ced2a4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150847 Mar 08 13:35:16.115352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1164/2020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:17.131455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:17.132068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:17.138755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:17.139298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:17.143953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:17.143953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:17.274851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:17.282596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-121cb2e8-0a40-41de-84f8-944de3f2f43f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155129 Mar 08 13:35:17.283156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 857/2021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:18.300176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:18.300868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:18.308038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:18.310503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:18.310503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:18.310503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:18.472951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:18.481248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6cc5af76-b672-403d-ab74-74eabd73b596 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.185343 Mar 08 13:35:18.481880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1165/2022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:19.499470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:19.500079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:19.506486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:19.506981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:19.507751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:19.508191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:19.638314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:19.646596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5c7059b2-692a-4716-b0de-d8fb0d27b6fb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151010 Mar 08 13:35:19.647157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 858/2023] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:20.663794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:20.664413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:20.670583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:20.671025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:20.671772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:20.672200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:20.803792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:20.811720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-80d30f89-ddc7-417d-8d20-dd72b1c09a8f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151765 Mar 08 13:35:20.812462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1166/2024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:21.829401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:21.830008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:21.836707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:21.837331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:21.837904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:21.838334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:21.974492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:21.982064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1444e59c-4358-42a8-99a9-d746e6de0f85 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156457 Mar 08 13:35:21.982623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 859/2025] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:22.999032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:22.999637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:23.006496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:23.006936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:23.007689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:23.008122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:23.142210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:23.150090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-60201dab-d6e1-4b1f-a5c9-20a29f3186e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154815 Mar 08 13:35:23.150658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1167/2026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:24.166859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:24.167548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:24.173691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:24.174641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:24.175426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:24.175853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:24.313425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:24.321224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-77e082e8-b1c4-4b19-a9ad-a2289cdf0bb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158119 Mar 08 13:35:24.321789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 860/2027] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:25.337877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:25.338572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:25.344943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:25.345398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:25.346695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:25.347184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:25.481809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:25.490057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-76c2353f-882d-42fe-8703-87159cf8daf0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156080 Mar 08 13:35:25.490622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1168/2028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:26.507110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:26.507700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:26.513987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:26.514432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:26.515189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:26.515620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:26.648828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:26.657845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-489ffa4c-3d77-4954-8e99-49f9770dbae2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154546 Mar 08 13:35:26.658914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 861/2029] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:27.675719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:27.676331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:27.682570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:27.683031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:27.683793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:27.684231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:27.823627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:27.831295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-21b6054d-1c15-401e-b007-5625f9ea6382 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159981 Mar 08 13:35:27.831847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1169/2030] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:28.849104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:28.849704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:28.855997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:28.856440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:28.857225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:28.857660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:28.990346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:28.998049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b62907ae-3961-4e23-bbc7-b9cb57144707 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153399 Mar 08 13:35:28.998612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 862/2031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:30.015252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:30.015778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:30.022245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:30.022692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:30.023466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:30.023900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:30.369515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:30.377937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7fc41e41-2997-477f-a341-177b92527dc2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.365889 Mar 08 13:35:30.378498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1170/2032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:31.395451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:31.396064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:31.402197 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:31.402654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:31.403427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:31.403867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:31.535261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:31.542987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b154f70e-a3ec-43ed-91e4-c36b11b2d25b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151859 Mar 08 13:35:31.543545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 863/2033] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:32.560536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:32.561179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:32.567713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:32.568179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:32.568972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:32.569414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:32.698268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:32.706099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-47c6a5af-f81e-4a2f-af1c-092b7e4c71cb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149598 Mar 08 13:35:32.706658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1171/2034] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:33.769342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:33.769951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:33.775755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:33.776203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:33.776997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:33.777435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:33.949726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:33.957550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e8dde6aa-b533-44d6-bb5c-f5669a8bf72d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.237854 Mar 08 13:35:33.958119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 864/2035] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:34.974654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:34.975266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:34.981688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:34.982140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:34.982901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:34.983338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:35.115145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:35.122921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d54a5b42-e83e-4d52-bc77-fabba17caffe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152076 Mar 08 13:35:35.123487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1172/2036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:36.140822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:36.141431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:36.148322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:36.148802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:36.149560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:36.149991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:36.281157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:36.289380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b38cce31-03bb-4163-b4ff-4df8a811d904 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152395 Mar 08 13:35:36.289873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 865/2037] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:37.307116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:37.307722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:37.314161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:37.314668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:37.315492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:37.315927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:37.443158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:37.450873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e33d5180-1d74-4e85-8970-3adf959335ed tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.147610 Mar 08 13:35:37.451438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1173/2038] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:38.468008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:38.468616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:38.475422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:38.475867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:38.476652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:38.477107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:38.604851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:38.613676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9a7f4cdb-ad85-452b-949a-fa9683906d04 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149523 Mar 08 13:35:38.614235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 866/2039] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:39.630879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:39.631408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:39.637784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:39.638309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:39.639078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:39.639516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:39.774128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:39.781962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-80d530b1-d419-4872-aa5b-e7a8eb16342f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155866 Mar 08 13:35:39.782520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1174/2040] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:40.799470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:40.800082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:40.806378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:40.806817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:40.807585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:40.808025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:41.195530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:41.203372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bed0c757-eb1f-4717-a48c-fa1e63cb26af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.407769 Mar 08 13:35:41.203940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 867/2041] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:42.221660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:42.222269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:42.228462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:42.228944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:42.229729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:42.230160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:42.358520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:42.367099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42327b5e-f9ef-42d8-8642-d49658dc888c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149997 Mar 08 13:35:42.367677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1175/2042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:42.686220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:35:42.686456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:35:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:35:43.383818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:43.384421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:43.390766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:43.391211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:43.391969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:43.392400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:43.527478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:43.535221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b9d3d729-8a32-4ceb-9e02-aff3774b3ca6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155271 Mar 08 13:35:43.535779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 868/2043] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:44.551626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:44.552166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:44.558462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:44.558910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:44.559662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:44.560094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:44.699646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:44.707974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0562af04-1c6b-4b5c-b256-8aaf9e6ff973 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160319 Mar 08 13:35:44.708532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1176/2044] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:45.724780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:45.725398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:45.731694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:45.732146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:45.732943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:45.733386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:45.864141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:45.871828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9e87d3d9-ace7-4162-90d4-d33de259b13d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150909 Mar 08 13:35:45.872382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 869/2045] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:46.889436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:46.890032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:46.896399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:46.896878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:46.897629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:46.898069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:47.027466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:47.035686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be5c1b8f-6b5b-4c14-9aa1-0d5a305ee43c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150126 Mar 08 13:35:47.036232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1177/2046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:48.053427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:48.054041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:48.060410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:48.060897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:48.061654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:48.062085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:48.192616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:48.202700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7a350917-3d01-463d-a575-17713620b687 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152444 Mar 08 13:35:48.202700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 870/2047] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:49.219020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:49.220492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:49.226907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:49.227364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:49.228146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:49.228564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:49.367234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:49.375071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-66d8d322-048e-4eb6-a12a-835a314efbdf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160108 Mar 08 13:35:49.375632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1178/2048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:50.395766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:50.396458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:50.409146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:50.409626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:50.410428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:50.410858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:50.544511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:50.553060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0bfb8967-8e8e-4ed3-9b13-c2bd30936fa9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.161645 Mar 08 13:35:50.553654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 871/2049] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:51.570362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:51.570968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:51.577262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:51.577654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:51.578410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:51.578849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:51.712260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:51.720629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a4e36bb-31d2-444d-86ae-ea5103f19444 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153433 Mar 08 13:35:51.721235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1179/2050] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:51.988878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:35:51.989359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:35:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:35:52.737938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:52.740809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:52.744845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:52.745297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:52.746063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:52.746500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:52.881701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:52.889628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b793a8cf-5295-4489-b79a-9832d051daac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155890 Mar 08 13:35:52.890194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 872/2051] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:53.906737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:53.908109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:53.914462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:53.914911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:53.915669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:53.916105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:54.044412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:54.052338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8cfc8232-1f6b-43a2-b098-54cd8ebafe45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149489 Mar 08 13:35:54.052942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1180/2052] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:55.070058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:55.070665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:55.076872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:55.077319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:55.078074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:55.078509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:55.209655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:55.217324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-658c01d1-e431-4d66-92b2-b637fbb72aef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151051 Mar 08 13:35:55.217868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 873/2053] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:56.235434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:56.236176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:56.242667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:56.243115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:56.243906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:56.244343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:56.377060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:56.384718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-62edcfb6-f3c9-410b-8996-52883eed7809 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153613 Mar 08 13:35:56.385274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1181/2054] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:57.401236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:57.401778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:57.408187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:57.408632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:57.409412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:57.409842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:57.544075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:57.551816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-902e354f-1a0d-4df2-9cf4-27957624a107 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154522 Mar 08 13:35:57.552403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 874/2055] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:58.569175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:58.569789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:58.575925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:58.576376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:58.577170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:58.577609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:58.710687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:58.718470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e78d90b9-ee9a-4521-b507-c0c412462027 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153181 Mar 08 13:35:58.719180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1182/2056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:35:59.736044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:35:59.736650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:35:59.743163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:59.743610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:59.744369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:35:59.744833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:35:59.877719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:35:59.885397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d2c6e746-1c85-4f28-b767-3259f47f0f00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153330 Mar 08 13:35:59.885964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 875/2057] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:35:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:00.903580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:00.904190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:00.911404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:00.912007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:00.912813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:00.913249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:01.052896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:01.060720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-95e4fddf-36a9-4459-961d-1f83c10a0122 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.161140 Mar 08 13:36:01.061287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1183/2058] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:02.077959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:02.079426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:02.085630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:02.086023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:02.086810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:02.087242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:02.221231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:02.228957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7c845022-1c15-419e-9beb-6982d09503d1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154830 Mar 08 13:36:02.229512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 876/2059] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:03.246406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:03.247049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:03.253361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:03.253816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:03.254576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:03.255018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:03.389472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:03.397143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0a29735d-6efe-4efe-b7c4-f09fca9786ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154603 Mar 08 13:36:03.397701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1184/2060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:04.414707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:04.415314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:04.421490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:04.422455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:04.423381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:04.423815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:04.554590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:04.562346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-11673098-bcd8-4dc9-9da2-5e16fced57bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151515 Mar 08 13:36:04.563484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 877/2061] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:05.580606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:05.581243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:05.587587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:05.588039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:05.588835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:05.589338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:05.718893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:05.726548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cdca3649-9f37-487d-85d7-d10ed76a0bfe tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150478 Mar 08 13:36:05.727111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1185/2062] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:06.743809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:06.744466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:06.750997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:06.751439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:06.752198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:06.752630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:06.882015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:06.889694 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d7c57ad8-f5a4-45fc-a9d1-788dc0a4329b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149786 Mar 08 13:36:06.890250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 878/2063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:07.907448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:07.907988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:07.914221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:07.914670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:07.915425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:07.915860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:08.048397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:08.056157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4851a8d3-dafd-48d7-9cef-7ada0cb87c05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152756 Mar 08 13:36:08.056735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1186/2064] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:09.073908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:09.074450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:09.081400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:09.081840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:09.082596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:09.083022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:09.217220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:09.225850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-652374e6-e473-4a03-97c9-4d6388765548 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155825 Mar 08 13:36:09.226423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 879/2065] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:10.243261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:10.243795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:10.250175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:10.251148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:10.252298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:10.252768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:10.392533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:10.400376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-399cddfc-f7c0-468c-a9f5-2c0184fff5f2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.161138 Mar 08 13:36:10.400970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1187/2066] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:11.417635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:11.418244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:11.426226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:11.426679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:11.427448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:11.427885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:11.558834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:11.566976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3830ed09-c477-4087-a4cd-1ce0f6b4b853 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153270 Mar 08 13:36:11.567527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 880/2067] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:36:12.584895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:12.585524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:12.591659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:12.592105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:12.592904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:12.593340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:12.728951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:12.737069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b6270f49-269b-4b38-a8c0-cdb523ee00bc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156066 Mar 08 13:36:12.737639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1188/2068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:13.758212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:13.758796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:13.765129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:13.765579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:13.766340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:13.766768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:13.899390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:13.907805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d5535724-e789-4d1b-9572-a35a341e2c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153235 Mar 08 13:36:13.908624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 881/2069] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:14.925763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:14.926374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:14.932195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:14.932636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:14.933414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:14.933845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:15.066161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:15.074738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bfd40aa1-fe74-4d72-b65f-28357dfd09cf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153557 Mar 08 13:36:15.075300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1189/2070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:16.092244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:16.092905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:16.099361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:16.099814 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:16.100601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:16.101064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:16.229661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:16.237887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f0c4912d-84b9-4a46-83de-c322e08876a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149494 Mar 08 13:36:16.238443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 882/2071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:17.255801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:17.256414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:17.263655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:17.264103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:17.264902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:17.265334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:17.409817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:17.418160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f0235008-810e-4436-95fd-ee6a8387e9b8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.166631 Mar 08 13:36:17.418733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1190/2072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:18.435644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:18.436254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:18.442670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:18.443070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:18.443834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:18.444271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:18.575770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:18.584222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2648916a-e1e1-49e8-912b-3c5a093229bf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152362 Mar 08 13:36:18.584820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 883/2073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:19.602154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:19.602805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:19.609213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:19.610220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:19.611233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:19.611665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:19.754343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:19.762512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9e61ba30-f484-411e-b3c1-6c70e7c6bb71 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.164300 Mar 08 13:36:19.763162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1191/2074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:20.779126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:20.779737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:20.786214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:20.786664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:20.787433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:20.787863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:20.920451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:20.928954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bdbfa03a-d791-4951-8766-e312f816a1af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153605 Mar 08 13:36:20.929513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 884/2075] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:21.946944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:21.947361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:21.953817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:21.954268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:21.955040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:21.955475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:22.090663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:22.098912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-17d8ffc7-5b97-4857-8851-6368871990b9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156157 Mar 08 13:36:22.099476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1192/2076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:23.115955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:23.116529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:23.122764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:23.123211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:23.123968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:23.124400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:23.256436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:23.264154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-23390907-0a7b-4991-9983-7f868dc96c3f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152111 Mar 08 13:36:23.264741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 885/2077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:24.281142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:24.281788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:24.287739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:24.288180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:24.288953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:24.289387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:24.426059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:24.434513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6af601cf-9626-464f-b44b-c295c5b91308 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.157272 Mar 08 13:36:24.435075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1193/2078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:25.452261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:25.452933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:25.459303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:25.459746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:25.460503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:25.460968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:25.594138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:25.602158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-16739e7e-7a68-4d5c-855b-f9b08ee0ceca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153679 Mar 08 13:36:25.602659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 886/2079] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:26.619442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:26.620063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:26.627033 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:26.627569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:26.628345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:26.628808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:26.760304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:26.769097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-404f358d-d87b-4948-908c-14df11758386 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153483 Mar 08 13:36:26.769667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1194/2080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:27.785977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:27.786584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:27.792873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:27.793285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:27.794035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:27.794466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:27.926104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:27.933855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3d2aab8f-f70b-4bf5-948d-edd275e25f0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151769 Mar 08 13:36:27.934442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 887/2081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:28.951553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:28.952206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:28.959310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:28.959765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:28.960529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:28.960995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:29.102348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:29.110989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-575dc13d-eaf0-4ae0-b367-856a3d3c52ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163002 Mar 08 13:36:29.111550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1195/2082] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:30.129333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:30.129847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:30.136116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:30.136573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:30.137370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:30.137807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:30.272083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:30.279809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ee40ba0f-ea48-4c82-8204-b8facc0533c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154995 Mar 08 13:36:30.280374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 888/2083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:31.297691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:31.298309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:31.304548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:31.305044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:31.305818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:31.306340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:31.448813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:31.456776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-74b2de06-bec5-4b70-abcd-7d13885d99dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163526 Mar 08 13:36:31.457340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1196/2084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:32.474384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:32.474958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:32.481487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:32.481626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:32.482287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:32.482721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:32.614705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:32.622428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-80a9f232-a514-479f-986a-cccc88c3ef55 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151927 Mar 08 13:36:32.622983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 889/2085] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:33.639158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:33.640075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:33.646160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:33.646602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:33.647356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:33.647784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:33.783055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:33.790805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-70b8fa7a-d6f9-4217-9a56-cc7db236db32 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155424 Mar 08 13:36:33.791371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1197/2086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:34.808378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:34.809016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:34.815745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:34.822143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:34.822143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:34.822143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:34.957496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:34.965326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-135b06b3-3636-4e7d-84c9-e3570c0f6970 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160816 Mar 08 13:36:34.965899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 890/2087] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:35.981945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:35.982461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:35.989048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:35.989502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:35.990270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:35.990707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:36.134765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:36.143642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1405aabb-dc13-4ad4-ae3b-2fc499a76039 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.165346 Mar 08 13:36:36.144002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1198/2088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:37.161338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:37.161969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:37.168137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:37.168592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:37.169390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:37.169835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:37.304624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:37.312551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0e10d921-c038-4da9-8770-7c6e9cdaeeef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154937 Mar 08 13:36:37.313158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 891/2089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:38.330482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:38.331212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:38.337712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:38.338163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:38.338961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:38.339399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:38.475278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:38.483406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-48844f33-92c4-4a43-b824-92fc634df747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158310 Mar 08 13:36:38.484126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1199/2090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:39.501717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:39.502320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:39.509206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:39.519293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:39.519293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:39.519293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:39.662740 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:39.672156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-738be377-eb8f-44dc-b2d1-3ed57576ea6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.175014 Mar 08 13:36:39.681881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 892/2091] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:40.689237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:40.689847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:40.696090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:40.711828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:40.711828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:40.711828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:40.830525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:40.838480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-78862602-18fe-4dc6-b45a-b179e8bf3763 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153143 Mar 08 13:36:40.839077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1200/2092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:41.856534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:41.857090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:41.863733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:41.864178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:41.864964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:41.865401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:41.997084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:42.004937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bafd9a84-ae03-46ce-a186-8ff3e9a89dfa tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152314 Mar 08 13:36:42.005495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 893/2093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:43.022908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:43.023563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:43.029780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:43.030761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:43.031605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:43.032036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:43.166419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:43.174877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-65566e9f-b0f0-4185-8874-bd7faf438c2f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156010 Mar 08 13:36:43.175437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1201/2094] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:44.192438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:44.193079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:44.199269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:44.199714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:44.200574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:44.201033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:44.334029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:44.341749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1aeee235-2e88-466b-98d4-38b09360f263 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153252 Mar 08 13:36:44.342377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 894/2095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:45.360205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:45.360848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:45.366774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:45.367230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:45.367971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:45.368401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:45.508291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:45.516340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3e4d711b-c162-4666-bb98-ae4fc91bd464 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160842 Mar 08 13:36:45.516943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1202/2096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:46.533769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:46.534371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:46.540822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:46.541269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:46.542026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:46.542455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:46.676562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:46.684803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aaf2a1a4-d437-458d-9c44-fc46c816fc64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155097 Mar 08 13:36:46.685364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 895/2097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:47.704291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:47.704916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:47.711397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:47.711850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:47.712609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:47.713073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:47.860551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:47.869499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7a1cfe5b-c0dc-4978-9d70-5e6f4e78dba5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.170007 Mar 08 13:36:47.870065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1203/2098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:48.887272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:48.887886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:48.894871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:48.895323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:48.896127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:48.896863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:49.038707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:49.046391 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-93b4676c-74ef-4e94-ac17-1d11c488c4ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163075 Mar 08 13:36:49.046950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 896/2099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:50.063699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:50.064309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:50.070568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:50.071018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:50.071782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:50.072221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:50.202883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:50.210553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b7c6e9af-53f1-4a1c-80c4-ef250629ddfc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151171 Mar 08 13:36:50.211110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1204/2100] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:51.228077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:51.228698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:51.235217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:51.235660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:51.236409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:51.236873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:51.366169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:51.374367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9ecbb8ef-312f-4e26-954b-278275e4c741 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150184 Mar 08 13:36:51.374920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 897/2101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:52.391316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:52.391969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:52.398347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:52.398827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:52.399596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:52.400039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:52.529666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:52.537337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1e59929c-9112-45f1-bfa2-6e5b8b26c37d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150312 Mar 08 13:36:52.537893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1205/2102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:53.555138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:53.555743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:53.562437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:53.562883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:53.563639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:53.564072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:53.697199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:53.705647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-221b3ddf-85b4-4e0a-a233-a8aecacbc83d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154308 Mar 08 13:36:53.706226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 898/2103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:54.722894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:54.723500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:54.729735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:54.730182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:54.730930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:54.731368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:54.868973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:54.877281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2ca9f626-87c0-43c9-9eae-0409b634a9f9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158266 Mar 08 13:36:54.877834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1206/2104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:36:55.894356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:55.894962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:55.901295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:55.901743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:55.902501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:55.902938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:56.034583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:56.042311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6da8a2fe-78bf-404d-945b-b370f02dbc26 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151838 Mar 08 13:36:56.044358 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 899/2105] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:57.060179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:57.060925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:57.067192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:57.067679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:57.068473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:57.068952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:57.210918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:57.219568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-87fd33aa-5252-449b-85df-b62b1e15f840 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163205 Mar 08 13:36:57.220278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1207/2106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:58.237614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:58.238260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:58.244500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:58.244986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:58.245914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:58.246359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:58.391646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:58.399819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a2dc379d-0efe-423b-8626-deef6a69b0bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.166301 Mar 08 13:36:58.400574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 900/2107] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:36:59.417491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:36:59.418095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:36:59.424442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:59.424918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:59.425684 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:36:59.426116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:36:59.569332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:36:59.577192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be504759-ec15-4b24-9431-366903ab5ac5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163363 Mar 08 13:36:59.577758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1208/2108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:36:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:00.594296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:00.594904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:00.601247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:00.601734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:00.602521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:00.602930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:00.735253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:00.742950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d1b5dec2-64a1-4c65-9334-9a0065ec2342 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153111 Mar 08 13:37:00.743507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 901/2109] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:01.760845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:01.761397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:01.768325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:01.768827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:01.769592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:01.770035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:01.920603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:01.928282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c63b45bc-89f7-47de-ab0a-ce1fe56734c6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.171456 Mar 08 13:37:01.928879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1209/2110] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:02.945882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:02.946498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:02.953420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:02.953870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:02.954662 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:02.955100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:03.088356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:03.096770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-31023454-728f-40ab-a759-d1475cf71b08 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155054 Mar 08 13:37:03.097331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 902/2111] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:04.114557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:04.115169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:04.121423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:04.121872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:04.122624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:04.123054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:04.255560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:04.263269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-95be0a5d-d3ef-4ada-a56a-cc52603c1079 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152667 Mar 08 13:37:04.263832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1210/2112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:05.280981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:05.281593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:05.287823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:05.288276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:05.289074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:05.289513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:05.419833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:05.428067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-95baff31-e421-4f27-8f5a-fc5f51a20910 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150972 Mar 08 13:37:05.428623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 903/2113] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:06.445952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:06.446557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:06.453456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:06.453899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:06.454649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:06.455082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:06.583462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:06.591252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c5eb4613-a545-43a8-8d00-eff10e89256d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149210 Mar 08 13:37:06.591815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1211/2114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:07.608716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:07.609526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:07.615872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:07.616427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:07.617219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:07.617680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:07.755095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:07.763078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0f5b2d71-910d-495a-ab18-7f029a638c44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158489 Mar 08 13:37:07.763629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 904/2115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:08.781275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:08.781886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:08.787759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:08.788206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:08.789023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:08.789460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:08.923398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:08.931074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-680e1b33-e3a3-4ee4-b3f7-8932a8b79ba3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154195 Mar 08 13:37:08.931641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1212/2116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:09.948745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:09.949434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:09.956685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:09.957231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:09.958073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:09.958514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:10.095822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:10.101490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-20e02206-a2d9-4bfc-9050-3ec241ba9cec tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156689 Mar 08 13:37:10.102052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 905/2117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:11.118154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:11.118700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:11.124981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:11.125433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:11.126192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:11.126630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:11.257758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:11.266078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5146182a-eb29-4269-a223-644818fc8968 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151952 Mar 08 13:37:11.266634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1213/2118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:12.283008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:12.283613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:12.289870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:12.290313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:12.291069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:12.291500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:12.421864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:12.429702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-03d6634e-c0e6-43c8-99c5-ae4330c51297 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151138 Mar 08 13:37:12.430447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 906/2119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:13.446870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:13.447514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:13.453971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:13.454426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:13.455179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:13.455616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:13.584009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:13.591753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54fc9c77-19f7-4120-8903-67b7b968db46 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148773 Mar 08 13:37:13.592312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1214/2120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:14.609523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:14.610094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:14.616259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:14.616732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:14.617488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:14.617918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:14.750780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:14.758449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c095e823-cb83-438c-9861-0bbb418a5e64 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153408 Mar 08 13:37:14.759014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 907/2121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:15.472904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:37:15.473415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:37:15.776503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:15.777134 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:15.783407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:15.783855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:15.784608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:15.785068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:15.918672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:15.926879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d267c716-379a-4b6c-9774-3ee975aa4dc0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154257 Mar 08 13:37:15.927424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1215/2122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:16.944648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:16.945315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:16.952307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:16.952781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:16.953544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:16.953976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:17.083436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:17.091568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-91f411b8-93e8-4ead-b1d0-fe0c546e1594 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150729 Mar 08 13:37:17.092149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 908/2123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:18.109176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:18.109817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:18.117956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:18.118605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:18.119838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:18.120286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:18.275458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:18.286073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0a2fcaac-7f23-47c3-8f7c-6f97b611ba05 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.181070 Mar 08 13:37:18.286751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1216/2124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:19.307109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:19.307663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:19.314078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:19.314520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:19.315294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:19.315724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:19.455025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:19.463280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-51a292a6-1e9e-42c9-afc0-a5971cba3eb7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160057 Mar 08 13:37:19.463925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 909/2125] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:20.480946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:20.481555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:20.488388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:20.488879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:20.489653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:20.490112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:20.622051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:20.629790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-146d170c-d7a8-48c4-8f62-71c62cd37402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152754 Mar 08 13:37:20.630339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1217/2126] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:21.653655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:21.654204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:21.660416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:21.660892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:21.661649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:21.662077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:21.791229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:21.799495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d8d7e6dc-a5c0-44e0-a8ea-9e1bd47b9fa3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149775 Mar 08 13:37:21.800083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 910/2127] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:22.817584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:22.818108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:22.824392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:22.824892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:22.825659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:22.826839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:22.960121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:22.967861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7e4dd434-b0c4-4400-8ee0-26aa56b58747 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154212 Mar 08 13:37:22.968424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1218/2128] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:23.985311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:23.985915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:23.992107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:23.992588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:23.993403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:23.993837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:24.123755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:24.131451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea7dd060-9539-475e-b9e0-0c13226652bb tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150465 Mar 08 13:37:24.132014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 911/2129] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:25.148907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:25.149521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:25.156015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:25.156488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:25.157281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:25.157714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:25.290844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:25.299305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-12a3948d-b2b3-4b78-a460-b5ab89f73193 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154276 Mar 08 13:37:25.299867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1219/2130] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:26.315498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:26.316079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:26.322588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:26.323034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:26.323805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:26.324243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:26.460398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:26.468129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9512487c-8140-41ea-9add-3bd885ad150b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156547 Mar 08 13:37:26.468944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 912/2131] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:26.766651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:37:26.768795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:37:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:37:27.485555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:27.486156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:27.492408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:27.492899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:27.493652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:27.494084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:27.628036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:27.635749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7ea9068d-34a3-4c52-bffa-de1d22db03c9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154989 Mar 08 13:37:27.636316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1220/2132] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:28.653889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:28.654453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:28.661264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:28.661710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:28.662466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:28.662895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:28.794289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:28.803428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e9ab3680-8327-4cbe-a85c-21e824f80530 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153479 Mar 08 13:37:28.803980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 913/2133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:29.248824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:37:29.249040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:37:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:37:29.819914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:29.820528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:29.826787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:29.827242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:29.828007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:29.828448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:29.961612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:29.969458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7f040b87-61df-4afb-bd43-0fcbcd616593 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153370 Mar 08 13:37:29.970012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1221/2134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:30.988364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:30.989030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:30.995300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:30.995755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:30.996531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:30.997002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:31.134208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:31.141795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c7167c5e-7a12-4b13-8656-4309502cad06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158484 Mar 08 13:37:31.142469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 914/2135] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:32.158884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:32.159426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:32.165649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:32.166098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:32.166855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:32.167284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:32.312613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:32.324365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54a188b3-c0cb-40ef-900a-fbfaa0f7d58b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.169047 Mar 08 13:37:32.325282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1222/2136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:33.347531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:33.348156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:33.354079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:33.354528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:33.355289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:33.355727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:33.483804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:33.492141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9ac214e3-c9e4-4945-b769-638ce37d3085 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148781 Mar 08 13:37:33.492715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 915/2137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:37:34.510060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:34.510666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:34.517724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:34.518174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:34.518963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:34.519396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:34.651653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:34.659866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-52ed01f1-68e1-4386-b981-b6a069ab75c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153674 Mar 08 13:37:34.660422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1223/2138] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:35.677491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:35.678100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:35.684328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:35.684816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:35.685613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:35.686049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:35.814785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:35.822465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cdb56e1f-4dbb-40ba-9ec4-af6431203bd0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149397 Mar 08 13:37:35.823011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 916/2139] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:36.839318 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:36.839923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:36.846389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:36.846832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:36.847586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:36.848015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:36.976891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:36.984824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d1668e9c-b0eb-4d15-9814-df03a756b8ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149336 Mar 08 13:37:36.985391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1224/2140] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:38.001906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:38.002497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:38.008804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:38.009253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:38.010014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:38.010450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:38.143028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:38.150658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-04aae05f-ea66-4053-acfa-a1c4e25d924d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152625 Mar 08 13:37:38.151204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 917/2141] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:39.167831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:39.168431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:39.175641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:39.176093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:39.176921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:39.177365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:39.312203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:39.320840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-207fd02d-cc71-47ad-9c82-3964f79cec2c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156800 Mar 08 13:37:39.321399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1225/2142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:37:39.864000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:37:39.864254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:37:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:37:40.338466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:40.339086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:40.347007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:40.347007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:40.347007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:40.347269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:40.478493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:40.487561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2e635c79-b56f-4e2f-ae1f-9ac6d9d27f25 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152903 Mar 08 13:37:40.488122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 918/2143] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:41.505259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:41.505869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:41.512114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:41.512559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:41.513364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:41.513810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:41.646064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:41.653807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7ba3cfa5-de88-4064-8b64-3f617a963cf1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152935 Mar 08 13:37:41.654389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1226/2144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:42.671242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:42.671883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:42.678152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:42.678598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:42.679357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:42.679790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:42.819491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:42.827364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-93dffdd4-7c55-481f-8224-b49444f98f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159994 Mar 08 13:37:42.827858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 919/2145] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:43.845667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:43.846348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:43.852541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:43.853023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:43.853775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:43.854233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:43.986721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:43.994383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c0ee64cb-3e15-48fb-afd9-141a739207b1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153133 Mar 08 13:37:43.994941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1227/2146] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:45.011076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:45.011697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:45.018332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:45.018781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:45.019565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:45.020004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:45.167422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:45.175839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3fb29727-f57f-40f2-829b-a1fd5fd8bdb6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.168689 Mar 08 13:37:45.176394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 920/2147] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:46.192755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:46.193381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:46.199472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:46.200065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:46.200688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:46.201130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:46.332407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:46.340059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8b3a3607-98f5-4f3b-a2d0-f17bdfc6f292 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151851 Mar 08 13:37:46.340607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1228/2148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:37:47.356351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:47.357010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:47.364200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:47.364673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:47.365446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:47.365884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:47.508434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:47.516165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-66707837-e3e0-4601-aa23-7ab02ef008a6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163680 Mar 08 13:37:47.516758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 921/2149] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:48.533688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:48.534295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:48.540638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:48.541116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:48.541870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:48.542311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:48.672118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:48.680760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0736aa9b-dfd8-4f5c-83c4-dbb953921221 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151492 Mar 08 13:37:48.681365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1229/2150] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:49.697732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:49.698339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:49.704967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:49.705411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:49.706173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:49.706606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:49.839316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:49.847682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3c80a770-f930-49b9-b86c-7d5058e5f476 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154174 Mar 08 13:37:49.848237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 922/2151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:50.865103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:50.865650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:50.871846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:50.872288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:50.873079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:50.873513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:51.010432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:51.018800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a117e9ae-2cfc-4b7d-a58e-77c5403fe257 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.157619 Mar 08 13:37:51.019353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1230/2152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:52.035988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:52.036735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:52.042962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:52.043413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:52.044180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:52.044615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:52.175833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:52.191333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a9406301-d89c-4ba3-858b-b2653a6d513b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159291 Mar 08 13:37:52.191897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 923/2153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:53.208493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:53.209148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:53.216079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:53.216527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:53.217350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:53.217789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:53.347521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:53.355395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1f3aea64-0c9b-4c79-88cf-446d28855e51 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150834 Mar 08 13:37:53.355953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1231/2154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:54.373344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:54.373961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:54.380923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:54.381370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:54.382136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:54.382569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:54.519416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:54.527105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7d2f4a84-d586-422c-8d3f-1e9e1290693b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.157613 Mar 08 13:37:54.527690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 924/2155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:55.545272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:55.545823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:55.552389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:55.552881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:55.553636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:55.554068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:55.687490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:55.695217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fdd24cea-8a0d-41af-a99b-2663c137eedd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154363 Mar 08 13:37:55.695773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1232/2156] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:56.712045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:56.720903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:56.720903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:56.720903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:56.721281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:56.721657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:56.862320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:56.870171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5d08b971-92a6-413b-b4ca-96222418dde8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.162024 Mar 08 13:37:56.870730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 925/2157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:57.887606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:57.888216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:57.894635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:57.895081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:57.895843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:57.896280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:58.025319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:58.033535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-01a3fb92-33c0-433f-b2fb-50ce0bcc80dc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149826 Mar 08 13:37:58.034085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1233/2158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:59.050937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:37:59.051578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:37:59.057853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:59.058319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:59.059088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:37:59.059526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:37:59.191795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:37:59.199595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-45ff4a0d-04aa-4612-ab18-57988efb1739 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153127 Mar 08 13:37:59.200152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 926/2159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:37:59 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:00.216671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:00.217279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:00.224152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:00.224601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:00.225397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:00.225829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:00.361186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:00.371443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-89b92d07-fcda-4c2c-a4fb-9655fbf59a19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158450 Mar 08 13:38:00.372332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1234/2160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:01.393453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:01.394058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:01.400271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:01.400745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:01.401506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:01.401947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:01.536680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:01.544557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0da4ea8f-4e56-46af-97e6-e25f05a76aad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155018 Mar 08 13:38:01.545147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 927/2161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:02.561887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:02.562690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:02.569887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:02.570424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:02.571327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:02.571838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:02.708799 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:02.716451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-85ee73d2-7160-40a6-8419-504e1fad085f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158450 Mar 08 13:38:02.717043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1235/2162] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:03.735220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:03.736036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:03.742604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:03.743090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:03.743890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:03.744321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:03.885203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:03.893594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2855f65f-ec5e-4da0-b1fb-d1c1a83e9311 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163163 Mar 08 13:38:03.894155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 928/2163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:04.910595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:04.911203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:04.917462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:04.917909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:04.918670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:04.919103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:05.047770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:05.056665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2cca73a3-8c89-4011-9d17-2109fbbea504 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149906 Mar 08 13:38:05.057234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1236/2164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:06.073706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:06.074356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:06.081349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:06.081792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:06.082548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:06.082982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:06.219710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:06.228338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ae631453-a475-453e-ab23-c7e12d7978c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158459 Mar 08 13:38:06.228988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 929/2165] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:06 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:07.246338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:07.246898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:07.253182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:07.253634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:07.254396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:07.254834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:07.387648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:07.396671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f234984f-7f56-4807-a604-468114e511dd tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154240 Mar 08 13:38:07.397232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1237/2166] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:08.414355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:08.414965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:08.421218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:08.421658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:08.422414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:08.422847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:08.552039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:08.559718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-63d60656-0b71-418e-8240-59b12a85ba3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149257 Mar 08 13:38:08.560279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 930/2167] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:09.576995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:09.577606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:09.584447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:09.584951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:09.585710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:09.586152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:09.715903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:09.724003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fbab81cb-852b-429d-849d-4c3dc5127595 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150833 Mar 08 13:38:09.724569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1238/2168] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:10.740960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:10.741602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:10.748010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:10.748459 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:10.749321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:10.749761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:10.883469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:10.891120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-45cf5e81-e64e-4ee7-943b-21e6dc230aba tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153959 Mar 08 13:38:10.891697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 931/2169] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:11.910307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:11.910917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:11.917201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:11.917644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:11.918401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:11.918830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:12.052621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:12.060306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f5bae334-e78c-45a2-bbc5-ba7a190a500d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155332 Mar 08 13:38:12.060899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1239/2170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:13.077928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:13.078548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:13.085726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:13.086178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:13.086944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:13.087385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:13.218203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:13.226388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f9c05988-fc41-4b56-91c6-9ed1c91966c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152227 Mar 08 13:38:13.226946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 932/2171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:13 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:14.243590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:14.244199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:14.250954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:14.252061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:14.252857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:14.253291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:14.387987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:14.396079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4a7cd56-fb34-44a4-898b-cc05e3658c96 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156506 Mar 08 13:38:14.396629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1240/2172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:15.413046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:15.413669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:15.419834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:15.420308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:15.421090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:15.421525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:15.556950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:15.565410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c9f3e4ba-1c5f-4818-ba30-a362adc9eed8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156335 Mar 08 13:38:15.565963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 933/2173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:16.582432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:16.583050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:16.589210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:16.589604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:16.590360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:16.590794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:16.722631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:16.730557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-68fc238a-a8a4-4484-974b-0d194a0facce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152013 Mar 08 13:38:16.731124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1241/2174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:17.748760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:17.749371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:17.756182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:17.756633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:17.757419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:17.757855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:17.889409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:17.897487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-70f0c106-f829-424b-a6aa-249ba3fcd6e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152599 Mar 08 13:38:17.898045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 934/2175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:18.915033 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:18.915639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:18.921923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:18.922367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:18.923116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:18.923553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:19.055883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:19.063872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4dd4689-8178-4c02-8405-10483cfb20ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152729 Mar 08 13:38:19.064429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1242/2176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:20.082577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:20.083174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:20.089443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:20.089895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:20.090657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:20.091091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:20.243810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:20.251969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-04ba6b36-7bad-44cb-887f-c56c9e57e091 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.173522 Mar 08 13:38:20.252533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 935/2177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:21.274419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:21.275039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:21.281290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:21.281747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:21.282512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:21.282956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:21.419502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:21.427845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9c8e5cb4-5de6-4d9d-bd17-2d255433ff19 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.157339 Mar 08 13:38:21.428417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1243/2178] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:22.445306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:22.445920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:22.452100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:22.452552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:22.453340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:22.453770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:22.837990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:22.845757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f853df6a-447e-4e46-8a81-4d6ddd44a0d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.405149 Mar 08 13:38:22.854775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 936/2179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:23.870474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:23.871078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:23.877338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:23.877779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:23.878534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:23.878963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:24.010763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:24.018473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d4cbd239-2e2f-4b60-af0d-9aa3038c0508 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151788 Mar 08 13:38:24.019031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1244/2180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:25.035661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:25.036303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:25.043059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:25.043511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:25.044280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:25.044904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:25.173157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:25.180950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f98873d6-debe-442b-ae1e-8b55dd0efe8c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149117 Mar 08 13:38:25.181514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 937/2181] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:26.198712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:26.199327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:26.205678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:26.206127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:26.206916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:26.207352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:26.336797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:26.344506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c64cece3-2b2c-440a-9432-5ceb7bf0a3d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149757 Mar 08 13:38:26.345317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1245/2182] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:27.361902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:27.362530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:27.369352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:27.369799 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:27.370563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:27.370996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:27.501167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:27.509601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-50b5fec3-1c82-4e38-a1d2-758b42a21f3c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151845 Mar 08 13:38:27.510154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 938/2183] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:28.527219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:28.527832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:28.534195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:28.534645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:28.535400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:28.535837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:28.671784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:28.679508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cb95b1f1-b290-4e2a-a767-3993a9b2dc00 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156169 Mar 08 13:38:28.680070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1246/2184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:29.697154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:29.697763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:29.703716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:29.704173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:29.704956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:29.705390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:29.837519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:29.845160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a4e3a133-829c-4127-9f86-406a407f7c31 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152205 Mar 08 13:38:29.845720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 939/2185] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:30.863266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:30.863881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:30.870795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:30.871246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:30.872015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:30.872454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:31.002280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:31.010065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-edbda498-af9b-4133-8cb7-870f40789d56 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150771 Mar 08 13:38:31.010631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1247/2186] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:32.027822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:32.028363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:32.034624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:32.035072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:32.035837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:32.036271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:32.169737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:32.177362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ecc48ca3-3668-4ad1-8801-d43f917ce73e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153596 Mar 08 13:38:32.177913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 940/2187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:33.196179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:33.196800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:33.203084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:33.203531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:33.204289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:33.204783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:33.338605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:33.346555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4bde22f-f0dd-4a91-a674-ade3f1d01dad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154952 Mar 08 13:38:33.347280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1248/2188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:33 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:34.364447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:34.365079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:34.371650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:34.372094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:34.372909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:34.373340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:34.515294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:34.523705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b55313fd-aa65-493b-99be-0d6cf285bf91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.162993 Mar 08 13:38:34.524260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 941/2189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:38:35.542356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:35.542967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:35.549224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:35.549677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:35.550431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:35.550865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:35.682969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:35.690576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-501ba379-fc1f-4b7a-b131-b238e44b0025 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152672 Mar 08 13:38:35.691132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1249/2190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:36.709077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:36.709837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:36.716189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:36.716636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:36.717431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:36.717976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:36.851467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:36.864469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-073d98b6-36cc-4efd-ad61-18faffbecee1 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160351 Mar 08 13:38:36.865070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 942/2191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:37.882393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:37.882991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:37.889248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:37.889694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:37.890445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:37.890877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:38.031093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:38.039702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ec9372f1-f07a-4fb0-a97d-7c9fa0b7ba06 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.161219 Mar 08 13:38:38.040467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1250/2192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:39.057090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:39.057695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:39.063918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:39.064366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:39.065144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:39.065578 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:39.202562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:39.211127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a3506eb4-7b10-40bc-9ff8-8f164dbf40f8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158053 Mar 08 13:38:39.211782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 943/2193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:40.228204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:40.228871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:40.235484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:40.235931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:40.236697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:40.237129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:40.373285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:40.381010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a7684f00-90fc-4a3b-8df5-6f0505965a2a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156660 Mar 08 13:38:40.386755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1251/2194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:41.399747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:41.400360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:41.406711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:41.407163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:41.408120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:41.408360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:41.538594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:41.546319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-73c466e5-9ffb-427c-acf3-66c0d8840b72 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151372 Mar 08 13:38:41.546875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 944/2195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:42.565040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:42.565603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:42.572961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:42.573404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:42.574172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:42.574611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:42.706172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:42.714101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a66ea03-c665-4476-939b-7e6d2a5b3556 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153690 Mar 08 13:38:42.714669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1252/2196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:43.731339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:43.731944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:43.738470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:43.738915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:43.739670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:43.740103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:43.875256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:43.883274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-143dcd69-032b-447c-a8e5-58accf62e682 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155802 Mar 08 13:38:43.883830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 945/2197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:44.900680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:44.901392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:44.907181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:44.907625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:44.908380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:44.908890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:45.039131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:45.046695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-16c308a1-3762-4ffa-87f4-f93bc69da325 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150193 Mar 08 13:38:45.047253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1253/2198] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:46.064527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:46.065151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:46.071353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:46.071796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:46.072561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:46.073022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:46.203059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:46.211142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5ab8d70d-f733-410c-9978-302a60938a59 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150545 Mar 08 13:38:46.211699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 946/2199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:47.231049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:47.231578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:47.238118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:47.238567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:47.239328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:47.239755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:47.372440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:47.380025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4b720ad6-d573-4e01-8ae2-eaf99b258251 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155559 Mar 08 13:38:47.380584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1254/2200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:47 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:48.399137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:48.399740 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:48.406003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:48.406490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:48.407239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:48.407669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:48.542535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:48.550245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e53cd8c1-1070-4e6c-b3e0-efcf5700b520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155950 Mar 08 13:38:48.550833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 947/2201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:49.567639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:49.568423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:49.575199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:49.575584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:49.576335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:49.576798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:49.719112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:49.727054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-30b67ca7-dff8-4c50-b151-989dfbe5bffc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.163730 Mar 08 13:38:49.727621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1255/2202] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:50.745604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:50.746217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:50.752501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:50.752985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:50.753757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:50.754179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:50.884982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:50.892816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a11af7cd-bff6-426d-a2ee-98018b6efcad tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151010 Mar 08 13:38:50.893478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 948/2203] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:38:51.910317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:51.910934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:51.917261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:51.917702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:51.918454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:51.918885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:52.053178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:52.061560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77d2ec46-143c-48c5-a973-46547957aab0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154989 Mar 08 13:38:52.062126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1256/2204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:53.079163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:53.079750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:53.086144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:53.086592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:53.087354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:53.087788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:53.215813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:53.223451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-734874ef-af53-4282-9ffc-9a8728d1b437 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148153 Mar 08 13:38:53.224006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 949/2205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:54.241028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:54.241645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:54.247885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:54.248343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:54.249135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:54.249578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:54.384561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:54.392363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6a333896-2073-48d0-88af-044b1147685b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155276 Mar 08 13:38:54.392997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1257/2206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:54 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:55.410060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:55.410617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:55.417528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:55.417992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:55.418955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:55.419193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:55.553643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:55.561333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f47be832-b80b-4cfc-b10e-599d384afe84 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155161 Mar 08 13:38:55.561892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 950/2207] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:56.578875 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:56.579483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:56.586365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:56.586809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:56.587562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:56.587992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:56.719441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:56.729280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58068202-55d9-40e6-b693-ec2ea5006c93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152907 Mar 08 13:38:56.729280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1258/2208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:57.746522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:57.747131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:57.753385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:57.753827 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:57.754580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:57.755013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:57.885395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:57.892996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-524820ad-3e0e-4fab-864c-cd782b938331 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150379 Mar 08 13:38:57.893542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 951/2209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:58.910326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:38:58.910940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:38:58.917870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:58.918321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:58.919080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:38:58.919517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:38:59.051088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:38:59.059519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d7585f8a-0bc5-4676-8840-5d361d6abd0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153121 Mar 08 13:38:59.060075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1259/2210] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:38:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:00.077570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:00.078173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:00.084392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:00.084871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:00.085734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:00.086855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:00.223723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:00.231747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c3fca31e-7767-4e5f-8a2e-459cda0513ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158323 Mar 08 13:39:00.232140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 952/2211] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:01.249280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:01.250082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:01.256766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:01.257319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:01.259087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:01.259609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:01.396625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:01.404906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9bb6eaba-aa37-4566-8cfd-c9235b1bf250 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159570 Mar 08 13:39:01.405469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1260/2212] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:02.422605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:02.423577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:02.434341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:02.435139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:02.436498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:02.437305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:02.578126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:02.585940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cfef4c72-4dd4-48bf-868a-3812f413a96a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.167385 Mar 08 13:39:02.586472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 953/2213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:02.694919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:39:02.695481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:39:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:39:03.603104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:03.603867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:03.610434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:03.610877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:03.611627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:03.612057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:03.748308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:03.755971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e64b3067-8526-4b75-9660-313c44348977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156794 Mar 08 13:39:03.756529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1261/2214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:04.772969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:04.773574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:04.780120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:04.780570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:04.781362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:04.781797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:04.923153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:04.931255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e50146d2-f3ff-4219-9d38-471effbe00c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.161965 Mar 08 13:39:04.932677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 954/2215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:05.949761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:05.950446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:05.956623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:05.957095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:05.960811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:05.960811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:06.086465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:06.095059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e2123353-683d-4e20-9c98-82769cd23c37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149632 Mar 08 13:39:06.096943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1262/2216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:07.114608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:07.115449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:07.122230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:07.122672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:07.123469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:07.123900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:07.297338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:07.297338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-49d2d4ff-32d8-42cc-8b6f-1911ffbfe3e0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160214 Mar 08 13:39:07.297338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 955/2217] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:08.289172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:08.289737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:08.296469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:08.300946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:08.300946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:08.300946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:08.431931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:08.440286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f0cad841-8204-4d54-a201-3d57925578f4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155150 Mar 08 13:39:08.440864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1263/2218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:09.457033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:09.457654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:09.464141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:09.464591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:09.465668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:09.466111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:09.595639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:09.603410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c23a26cb-a15f-4bf9-a8c5-f6e98e0e27a7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150161 Mar 08 13:39:09.603975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 956/2219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:10.621967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:10.622524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:10.628737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:10.629194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:10.629952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:10.630393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:10.763240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:10.771067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-293de851-239a-4487-a527-eb5e127b6d8b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153167 Mar 08 13:39:10.771628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1264/2220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:11.788535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:11.789177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:11.795981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:11.796427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:11.797221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:11.797656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:11.931442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:11.939444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-abea151e-64c3-460b-b530-9f1c57422520 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154862 Mar 08 13:39:11.940003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 957/2221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:39:11.998177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:39:11.998321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:39:12.956570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:12.957207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:12.964011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:12.964385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:12.970026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:12.970026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:13.098977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:13.107838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cef68175-e246-4826-878b-cc1f86c210af tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.155337 Mar 08 13:39:13.108393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1265/2222] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:14.125874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:14.126486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:14.132770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:14.133218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:14.133980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:14.134417 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:14.265750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:14.273670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea3e35d6-6d25-40e8-9ff1-18c722edce0f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151700 Mar 08 13:39:14.274225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 958/2223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:15.290888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:15.291493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:15.297657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:15.298111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:15.298868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:15.299300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:15.448243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:15.456890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b06dbd11-7f02-4f87-816b-199c73395416 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.169817 Mar 08 13:39:15.457441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1266/2224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:16.474118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:16.474715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:16.481700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:16.482193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:16.483010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:16.483453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:16.617351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:16.625230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eec803e1-105b-4092-8a7d-a379b0261170 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154951 Mar 08 13:39:16.625789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 959/2225] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:17.642140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:17.642782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:17.648942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:17.649489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:17.650272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:17.650702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:17.779557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:17.787178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7a3d6734-937f-417d-bea8-4cd6e9670cab tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148890 Mar 08 13:39:17.787733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1267/2226] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:18.804362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:18.804933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:18.811639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:18.812099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:18.812882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:18.813315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:18.946238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:18.954715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-59fd3efe-d9ce-4568-a64e-5b2f8c873c6d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154173 Mar 08 13:39:18.955277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 960/2227] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:19.972272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:19.972903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:19.979195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:19.979637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:19.980531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:19.980990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:20.119861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:20.128094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2169de32-9b74-414b-b895-0bc5803fa324 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159722 Mar 08 13:39:20.128649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1268/2228] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:19 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:21.145754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:21.146356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:21.152688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:21.153142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:21.153930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:21.154361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:21.285795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:21.294881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-422075eb-0a16-4658-bcd5-b260b2c8e846 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152998 Mar 08 13:39:21.295440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 961/2229] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:39:22.312122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:22.312774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:22.319426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:22.320072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:22.321307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:22.322027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:22.471931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:22.482821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3c37e645-3daf-47f8-89e1-1315269356c3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.175121 Mar 08 13:39:22.483734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1269/2230] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:23.500800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:23.508260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:23.508260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:23.508260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:23.509004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:23.509437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:23.645452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:23.653094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a62e3f91-f072-4004-99d1-29a7baa82040 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156441 Mar 08 13:39:23.653763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 962/2231] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:24.670289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:24.670898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:24.677207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:24.677652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:24.678406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:24.678842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:24.810717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:24.818397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0c6346f-4b16-42de-9697-5434121ef5df tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152145 Mar 08 13:39:24.818964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1270/2232] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:25.836222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:25.836858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:25.843820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:25.844266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:25.845075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:25.845514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:25.976540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:25.984652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f118fe83-8f2e-4cf6-b269-005fbfd96e82 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151935 Mar 08 13:39:25.985214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 963/2233] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:27.002021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:27.002766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:27.008880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:27.009329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:27.010089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:27.010545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:27.141174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:27.148857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1f4fc475-1103-4f31-98cc-09c5cb483fe0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151165 Mar 08 13:39:27.149415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1271/2234] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:26 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:28.165841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:28.166451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:28.172957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:28.173406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:28.174164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:28.174600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:28.314790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:28.322888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-34cc71b3-9364-4d3b-a93b-b0693a054399 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160826 Mar 08 13:39:28.323450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 964/2235] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:29.350543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:29.351166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:29.358074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:29.358498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:29.359512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:29.359947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:29.488917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:29.496680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d36a886a-0399-479c-a2b5-3a7d8dd16d2b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149962 Mar 08 13:39:29.497237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1272/2236] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:30.514385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:30.515148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:30.525137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:30.525637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:30.526397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:30.526830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:30.656603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:30.664223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0b120b5f-67b1-4c3a-8851-b702156d66f5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153958 Mar 08 13:39:30.664801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 965/2237] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:31.681357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:31.681967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:31.688845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:31.689289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:31.690041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:31.690473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:31.829444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:31.837185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b492d427-bcf8-4626-91d3-b537cb9469e2 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159700 Mar 08 13:39:31.837743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1273/2238] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:32.853603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:32.854208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:32.860474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:32.860996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:32.861718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:32.862353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:32.999952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:33.007660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2055f3e7-ecb7-4caf-9b6f-937fd6d3080c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.157809 Mar 08 13:39:33.008207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 966/2239] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:34.025545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:34.026165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:34.033099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:34.033549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:34.034309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:34.034745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:34.172274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:34.179994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f7bdd383-6d9f-4a3d-8d32-87042bf46e27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158336 Mar 08 13:39:34.180547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1274/2240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:35.197837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:35.198437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:35.204614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:35.205101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:35.205851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:35.206277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:35.337408 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:35.345253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f50dd339-5bfe-45ee-bc47-8d9a58d9b32e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151175 Mar 08 13:39:35.345806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 967/2241] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:36.362662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:36.363297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:36.369543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:36.369991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:36.370750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:36.371183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:36.619252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:36.626970 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-db99b032-ac48-402c-9bc0-6ef2bbb4b532 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.268394 Mar 08 13:39:36.627530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1275/2242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:36 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:37.645013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:37.645622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:37.651909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:37.652350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:37.653126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:37.653556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:37.783075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:37.791349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-897b2951-259f-46d1-8630-56b5017dc920 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150677 Mar 08 13:39:37.791894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 968/2243] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:37 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:38.808503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:38.809197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:38.815443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:38.815969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:38.816753 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:38.817183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:38.946103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:38.953811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7bcf2951-e5b9-41d2-bc0a-b8975e0574d3 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149154 Mar 08 13:39:38.954365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1276/2244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:38 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:39.971056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:39.971669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:39.978009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:39.978460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:39.979217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:39.979649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:40.112604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:40.120970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f1c7d171-5175-4e33-b76d-a89dd7dce030 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153636 Mar 08 13:39:40.121524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 969/2245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:39 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:41.138742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:41.139358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:41.146400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:41.146855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:41.147617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:41.148055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:41.277504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:41.285745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ad002d82-64ff-445f-ab71-a7570012cda6 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.150399 Mar 08 13:39:41.286372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1277/2246] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:41 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:42.302815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:42.303431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:42.309740 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:42.310190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:42.310956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:42.311395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:42.442185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:42.449962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8a5632e6-6c32-4c63-916f-0fe1b18dab88 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151555 Mar 08 13:39:42.450514 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 970/2247] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:42 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:43.467117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:43.467733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:43.474569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:43.475008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:43.475766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:43.476198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:43.609538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:43.617486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-07a51032-c9ff-45e6-b5e4-860bb4862566 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154131 Mar 08 13:39:43.618035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1278/2248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:43 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:44.635038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:44.635671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:44.641985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:44.642430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:44.643191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:44.643625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:44.777443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:44.785062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-400387c1-e04a-4706-8d59-0d598c34b3b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153835 Mar 08 13:39:44.785642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 971/2249] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:44 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:45.802336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:45.802952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:45.808827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:45.809284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:45.810048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:45.810490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:45.944774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:45.953132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0a33d28b-abc0-4625-8657-700d4d996f44 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154916 Mar 08 13:39:45.953695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1279/2250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:45 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:46.970334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:46.970933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:46.977188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:46.977638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:46.978403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:46.978852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:47.111515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:47.119858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cfc2c9cc-ce8d-4c09-9271-f7af38d1fda0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153364 Mar 08 13:39:47.120416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 972/2251] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:46 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:48.137958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:48.138552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:48.145356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:48.145810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:48.146564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:48.146999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:48.294557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:48.302567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e568d113-a217-48ee-ac58-d4d54b883977 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.168488 Mar 08 13:39:48.303129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1280/2252] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:48 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:49.320357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:49.321076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:49.327377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:49.332148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:49.332148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:49.332148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:49.461651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:49.469376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-17cf499d-04b6-4cb0-be04-13c9a9cb1065 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153602 Mar 08 13:39:49.469928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 973/2253] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:49 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:50.486719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:50.487323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:50.493734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:50.494176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:50.494929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:50.495357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:50.627936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:50.636171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-401c926d-4822-475e-ab1e-d48429ba0952 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153575 Mar 08 13:39:50.636746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1281/2254] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:50 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:51.653688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:51.654230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:51.661273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:51.661719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:51.662473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:51.662906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:51.795595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:51.803467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-de1a38cc-7d60-4bb6-a47e-f587d62a8881 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153734 Mar 08 13:39:51.804021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 974/2255] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:51 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:52.821555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:52.822164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:52.828582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:52.829070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:52.829828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:52.830265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:52.966330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:52.973973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3d3c530b-e93f-41fe-be5c-0e86f2a3e611 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.157048 Mar 08 13:39:52.974519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1282/2256] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:52 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:53.991446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:53.992053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:53.998253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:53.998769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:53.999536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:53.999980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:54.132957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:54.141432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-937ed199-9a3e-4075-9515-8a5b0e07ea9d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154346 Mar 08 13:39:54.141996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 975/2257] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:53 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:55.159152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:55.159758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:55.165981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:55.166424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:55.167177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:55.167612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:55.511177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:55.518906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0114974-0f68-4047-b1bf-374567e54639 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.363598 Mar 08 13:39:55.519454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1283/2258] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:55 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:56.536399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:56.537048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:56.543549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:56.544003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:56.544808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:56.545249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:56.686386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:56.694903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8e6a8afd-fa1f-4604-8094-052714a67cce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.162397 Mar 08 13:39:56.695462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 976/2259] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:56 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:57.712020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:57.712674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:57.718882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:57.719331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:57.720081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:57.720512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:57.847658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:57.855919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-90abfd77-cbfb-4dad-9ba9-3d757209a765 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.147767 Mar 08 13:39:57.856482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1284/2260] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:57 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:58.874135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:39:58.874710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:39:58.881632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:58.882084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:58.882846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:39:58.883281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:39:59.011862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:39:59.019485 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d20e0002-65d3-425b-b9da-e7754b76105a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149309 Mar 08 13:39:59.020084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 977/2261] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:39:58 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:00.037294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:00.037902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:00.044151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:00.044599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:00.045388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:00.045821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:00.178374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:00.186048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dbdb6757-6e8c-4623-8149-e7d40b2224ce tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153175 Mar 08 13:40:00.186617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1285/2262] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:00 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:01.203192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:01.203799 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:01.210681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:01.211124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:01.211877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:01.212306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:01.349945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:01.357728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-339539ab-5b72-4096-b0f3-b7e682957b57 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.158244 Mar 08 13:40:01.358300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 978/2263] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:01 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:02.374546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:02.375203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:02.381664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:02.382117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:02.382870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:02.383299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:02.511218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:02.519228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42bfe454-9534-408d-a606-c774dbb91a75 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148448 Mar 08 13:40:02.519788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1286/2264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:02 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:03.537479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:03.538095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:03.544037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:03.544484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:03.545289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:03.545725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:03.798121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:03.807258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-699edeae-ad8a-40e1-a5cf-da7234cca5c8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.274035 Mar 08 13:40:03.808126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 979/2265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:03 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:04.824179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:04.825676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:04.832435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:04.833055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:04.833843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:04.834321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:04.976766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:04.984610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-55ea0e1a-f709-4a9a-870b-95e9cd4d4de8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.164105 Mar 08 13:40:04.985198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1287/2266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:04 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:06.001328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:06.001938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:06.008256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:06.008745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:06.009513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:06.009952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:06.142041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:06.150451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-917411fc-77c9-4de4-ba4e-d37f1264836e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152894 Mar 08 13:40:06.151011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 980/2267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:05 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:07.168893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:07.169498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:07.175659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:07.176105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:07.177023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:07.177466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:07.316524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:07.325052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8b70ca13-c429-475f-a578-94dcee593a91 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.159988 Mar 08 13:40:07.325619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1288/2268] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:07 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:08.342764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:08.343306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:08.350826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:08.351277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:08.352046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:08.352474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:08.484623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:08.492276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-17d30e45-45ed-4926-ac95-41c636285203 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153650 Mar 08 13:40:08.492871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 981/2269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:08 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:09.509614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:09.510214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:09.516451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:09.516923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:09.517671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:09.518102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:09.651610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:09.659369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-982d79fb-cab8-4648-a4b0-0bdf7a2d7e2d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153581 Mar 08 13:40:09.659931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1289/2270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:09 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:10.677333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:10.677973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:10.684188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:10.684638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:10.685426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:10.685860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:10.816974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:10.825187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-42cec2e9-7800-49b4-9722-cc32df522adf tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.151901 Mar 08 13:40:10.825736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 982/2271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:10 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:11.842703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:11.843366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:11.850137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:11.850587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:11.851353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:11.851929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:11.980005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:11.988034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54f58880-6dd5-4629-83c3-a83b4e0510d9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148995 Mar 08 13:40:11.988600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1290/2272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:11 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:13.004819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:13.005349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:13.012569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:13.013043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:13.013801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:13.014234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:13.146899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:13.154495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9bf9f7cc-a8bc-48c8-8fcd-085156cc16c7 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153603 Mar 08 13:40:13.155066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 983/2273] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:12 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:14.171295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:14.171907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:14.178908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:14.179367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:14.180135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:14.180574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:14.312157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:14.320742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a7ca26f-b4f2-4067-b1c5-d18a76e7d4c4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153226 Mar 08 13:40:14.324390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1291/2274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:14 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:15.338581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:15.339186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:15.345412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:15.345857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:15.346618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:15.347048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:15.479031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:15.487011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-51d2bff9-a77d-43a4-ba9b-c445d479c6ca tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152283 Mar 08 13:40:15.489797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 984/2275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:15 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:16.505115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:16.505727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:16.511606 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:16.512054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:16.512837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:16.513272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:16.646587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:16.655832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7f2b7c28-67cb-44fc-a733-faffc452c231 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154727 Mar 08 13:40:16.656404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1292/2276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:16 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:17.673984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:17.674690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:17.682087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:17.682540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:17.683306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:17.683748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:17.816452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:17.824353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a50ee33a-fdc5-42e2-b525-50940c082f50 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154339 Mar 08 13:40:17.824938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 985/2277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:17 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:18.841963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:18.842578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:18.849064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:18.849521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:18.850286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:18.850725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:18.983282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:18.991834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-73782654-df09-4541-9b5a-3f6639088c0c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153764 Mar 08 13:40:18.992392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1293/2278] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:18 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:20.009486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:20.010101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:20.016389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:20.016881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:20.017649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:20.018087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:20.151696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:20.159494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6c858a3e-b47b-4202-957e-480c0912fc93 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153873 Mar 08 13:40:20.160054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 986/2279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:20 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:21.175720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:21.176565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:21.182967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:21.183424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:21.184192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:21.184637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:21.324337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:21.332075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eab58bcf-420c-4f57-a075-d31de98000ff tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.160256 Mar 08 13:40:21.333189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1294/2280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:21 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:22.350969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:22.351612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:22.357817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:22.358256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:22.359015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:22.359708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:22.493155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:22.500970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0ca919ae-225d-4663-9959-67790c2d92cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154373 Mar 08 13:40:22.501516 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 987/2281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:22 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:23.518411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:23.519146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:23.526533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:23.526976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:23.534102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:23.534102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:23.675428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:23.684911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2e7af170-7fd7-403e-b842-1899e4133053 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.170434 Mar 08 13:40:23.685486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1295/2282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:23 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:24.705264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:24.705882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:24.712747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:24.713201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:24.713970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:24.714409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:24.850139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:24.858067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d21f8165-a007-4ba4-8c0e-10bf3f96e26e tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.156595 Mar 08 13:40:24.858632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 988/2283] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:24 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:25.875965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:25.876603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:25.883630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:25.884084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:25.884885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:25.885329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:26.017798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:26.025763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8ca9e381-7467-4362-854c-6f385cbafbc5 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153611 Mar 08 13:40:26.026329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1296/2284] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:25 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:27.043253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:27.044125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:27.050591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:27.051123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:27.052057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:27.052519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:27.180231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:27.187813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9c24bcbc-4d7a-4cf7-80c8-1bf2d3a0662f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.148469 Mar 08 13:40:27.188361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 989/2285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:27 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:28.205603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:28.206209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:28.212513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:28.213065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:28.213825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:28.214263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:28.347478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:28.356291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-856f74d8-0fd7-4ab3-be35-974f0f23c20c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154555 Mar 08 13:40:28.356879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1297/2286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:28 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:29.374825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:29.375483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:29.382508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:29.382956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:29.383752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:29.384195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:29.516354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:29.524321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4a1a6de3-e033-4b4e-9fc5-2adc96da8dbc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.153358 Mar 08 13:40:29.524911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 990/2287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:29 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:30.541887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:30.542491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:30.548816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:30.549268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:30.550022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:30.550457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:30.680014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:30.687739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d70cb6f7-9296-4097-94bb-c28d46912e29 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.149738 Mar 08 13:40:30.688651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1298/2288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:30 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:31.706449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:31.707766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:31.714106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:31.714550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:31.716291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:31.716291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:31.848965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:31.856615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4fd370cb-f252-4ed5-943d-c028fe1d7788 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.154119 Mar 08 13:40:31.857195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 991/2289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:31 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:32.978739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:32.979349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:32.985488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:32.985930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:32.986679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:32.987107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:33.125917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:33.134524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2c56e3f5-aee0-4cab-ba30-c1e8815e246b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.264253 Mar 08 13:40:33.135120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1299/2290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:32 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:34.151638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:34.152200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:34.158335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:34.158786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:34.159549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:34.159983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:34.357652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:34.367919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0381ef87-6da2-4cc2-822e-13d716822316 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.220046 Mar 08 13:40:34.368567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 992/2291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:34 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:35.385755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:35.386278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:35.392471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:35.393024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:35.393782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:35.394230 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:35.482059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:40:35.482418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:40:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 (ip 10.222.0.52) !!! Mar 08 13:40:35.526641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:35.534337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b3d1a5d2-9016-4524-b948-284d74e5cc5b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 200 len: 1727 microversion: 2.1 time: 0.152468 Mar 08 13:40:35.534889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1300/2292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:35 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:35.552290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ed8eea51-118e-463a-8ad6-8be224b1e3ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '.version_select at 0x7f5e31f79310>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:35.555857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed8eea51-118e-463a-8ad6-8be224b1e3ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [6ae8ca2f-692f-4a15-905e-ccfd000bf8b4] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 13:40:36.564533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed8eea51-118e-463a-8ad6-8be224b1e3ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [6ae8ca2f-692f-4a15-905e-ccfd000bf8b4] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58174. Mar 08 13:40:36.661388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ed8eea51-118e-463a-8ad6-8be224b1e3ae tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585172195" status: 202 len: 0 microversion: 2.1 time: 1.113368 Mar 08 13:40:36.661954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 993/2293] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Mar 8 13:40:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585172195 => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:40:37.733888 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-ce7f222a-c05f-400b-abb7-76fc7731056a req-ab7f503a-eb86-49a8-b9c3-a22cb1602730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "701ec119-507b-4b00-b365-bb76f36feab1", "tag": "96401a0d-79b1-4f30-8dd7-46c5c4b2731f"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:37.742534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-ce7f222a-c05f-400b-abb7-76fc7731056a req-ab7f503a-eb86-49a8-b9c3-a22cb1602730 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:37.743214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-ce7f222a-c05f-400b-abb7-76fc7731056a req-ab7f503a-eb86-49a8-b9c3-a22cb1602730 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:37.756972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-ce7f222a-c05f-400b-abb7-76fc7731056a req-ab7f503a-eb86-49a8-b9c3-a22cb1602730 service nova] Creating event network-changed:96401a0d-79b1-4f30-8dd7-46c5c4b2731f for instance 701ec119-507b-4b00-b365-bb76f36feab1 on hv-cinder-83009 Mar 08 13:40:37.763720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-ce7f222a-c05f-400b-abb7-76fc7731056a req-ab7f503a-eb86-49a8-b9c3-a22cb1602730 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100755 Mar 08 13:40:37.764587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1301/2294] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:40:37.820467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b8883f3d-5a40-43ed-8c1c-c4e1590a2d37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: .version_select at 0x7f5e31fa4f70>, body: {"keypair": {"name": "tempest-keypair-1480135837"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:37.836448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-b8883f3d-5a40-43ed-8c1c-c4e1590a2d37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:40:37.841148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-b8883f3d-5a40-43ed-8c1c-c4e1590a2d37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:40:38.198267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-b8883f3d-5a40-43ed-8c1c-c4e1590a2d37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:40:38.202613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-b8883f3d-5a40-43ed-8c1c-c4e1590a2d37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:40:38.216823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b8883f3d-5a40-43ed-8c1c-c4e1590a2d37 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.401046 Mar 08 13:40:38.217596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 994/2295] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:40:37 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:40:40.488984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:40.489805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:40.496030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:40.497553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:40.497553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:40.497843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:40.525582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:40:40.531863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.compute.api [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Working on deleting snapshot b519ded9-904b-4bb1-8200-1db5c44a3abf from shelved instance... Mar 08 13:40:40.599751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:40.600321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:40.606018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:40.606569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:40.607513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:40.608124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:40.635381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:40:40.918028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d2975521-4cc7-4836-b004-ee2f61fa5d22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 204 len: 0 microversion: 2.1 time: 0.322748 Mar 08 13:40:40.918944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 995/2296] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:40:40 2022] DELETE /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:40:40.926943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1868417934", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03edc10a-5365-4b5f-86af-57e7b3dff290"}], "security_groups": [{"name": "tempest-securitygroup--945442942"}], "key_name": "tempest-keypair-1480135837", "user_data": "}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:41.033714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.network.neutron [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] validate_networks() for [('03edc10a-5365-4b5f-86af-57e7b3dff290', None, None, None, None, None)] {{(pid=117282) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:40:41.495305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:40:41.495730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:40:41.496234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:40:41.496629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:40:41.497218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:40:41.506729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:41.507301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:41.508090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:41.508519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:41.524576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:40:41.528416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:40:41.539211 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Going to run 1 instances... {{(pid=117282) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:40:41.541580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:40:41.666428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [128fb91c-ea65-472b-8bfe-1bb01032bec0] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 13:40:42.022993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Doing local delete in cell 5b93ebe6-7227-4cf2-85fc-4a30a39b2f72(cell1) {{(pid=117280) _delete /opt/stack/nova/nova/compute/api.py:2489}} Mar 08 13:40:42.023788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:42.024226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:42.024700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.compute.api [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 08 13:40:42.031430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] deallocate_for_instance() {{(pid=117280) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Mar 08 13:40:42.674375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [128fb91c-ea65-472b-8bfe-1bb01032bec0] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58314. Mar 08 13:40:42.679953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a07369d2-3015-4f84-a7c9-6360936023de tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.759353 Mar 08 13:40:42.680743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 996/2297] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:40:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:40:42.686233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:42.687153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:42.694440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:42.694992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:42.695913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:42.696448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:42.912869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:42.925039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b017a88-8747-430c-9ea9-e7eaab7f8c3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.242975 Mar 08 13:40:42.929378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 997/2298] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:42.945486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-281d080c-be14-4985-b534-070370d58984 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:42.946255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-281d080c-be14-4985-b534-070370d58984 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:43.043511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-281d080c-be14-4985-b534-070370d58984 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:43.052737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-281d080c-be14-4985-b534-070370d58984 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1242 microversion: 2.1 time: 0.119859 Mar 08 13:40:43.052737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 998/2299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:42 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:43.236251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-ebe3c444-84c6-4553-9732-65b4b7088e51 req-1ae3428f-7a0f-435a-941b-ab6bfeea23df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9aabe1-38e8-4c68-aafc-9a389ce1c127", "name": "network-vif-deleted", "tag": "5aa555ed-04a0-4927-ab06-464b9c259a70"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:43.237525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Updating instance_info_cache with network_info: [] {{(pid=117280) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Mar 08 13:40:43.248649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-ebe3c444-84c6-4553-9732-65b4b7088e51 req-1ae3428f-7a0f-435a-941b-ab6bfeea23df service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:43.249825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-ebe3c444-84c6-4553-9732-65b4b7088e51 req-1ae3428f-7a0f-435a-941b-ab6bfeea23df service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:43.268127 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.compute.server_external_events [req-ebe3c444-84c6-4553-9732-65b4b7088e51 req-1ae3428f-7a0f-435a-941b-ab6bfeea23df service nova] Unable to find a host for instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127. Dropping event network-vif-deleted {{(pid=117282) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 13:40:43.269295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-ebe3c444-84c6-4553-9732-65b4b7088e51 req-1ae3428f-7a0f-435a-941b-ab6bfeea23df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.104696 Mar 08 13:40:43.271489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 999/2300] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 107 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 08 13:40:43.277883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e00bf682-fc10-4ec0-85c5-34f59d95f15c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] Calling method '.version_select at 0x7f5e31fb24c0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:43.469620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e00bf682-fc10-4ec0-85c5-34f59d95f15c tempest-TestVolumeBootPattern-1912722956 tempest-TestVolumeBootPattern-1912722956-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1996988874" status: 202 len: 0 microversion: 2.1 time: 0.196833 Mar 08 13:40:43.470221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1000/2301] 10.222.0.52 () {58 vars in 1262 bytes} [Tue Mar 8 13:40:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1996988874 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:40:43.946927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:43.948772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:43.962977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:43.964544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:43.965548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:43.966338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:44.121472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:44.137424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eec11563-64a2-4a3e-a1b0-b929dc4b0d30 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.193336 Mar 08 13:40:44.144080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1001/2302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:43 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:40:44.154837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:44.155491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:44.163969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:44.164351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:44.165189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:44.165624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:44.236081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.scheduler.client.report [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Deleted allocations for instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 Mar 08 13:40:44.238370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:44.246168 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-49229163-aeff-4ea3-886c-9f6ad37b886b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1246 microversion: 2.1 time: 0.105751 Mar 08 13:40:44.247074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1002/2303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:44 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:44.636800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-78ff27f1-1af9-43a7-88d3-36dde55cfc4c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 204 len: 0 microversion: 2.20 time: 4.152685 Mar 08 13:40:44.637493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1302/2304] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Mar 8 13:40:40 2022] DELETE /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 0 bytes in 4154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 13:40:44.647131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:44.647777 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:44.654343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:44.654797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:44.655579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:44.656057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:44.672972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 could not be found. Mar 08 13:40:44.672972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 404 to user: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:40:44.673291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b70af396-6663-412d-8661-4ce8634db94f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 404 len: 111 microversion: 2.20 time: 0.030798 Mar 08 13:40:44.673680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1003/2305] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:44 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 08 13:40:44.683155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-86a87bc8-5411-45a7-ad4b-3798ce328ee4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '.version_select at 0x7f5e2d3cd3a0>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:44.781907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-86a87bc8-5411-45a7-ad4b-3798ce328ee4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216902503" status: 204 len: 0 microversion: 2.20 time: 0.103091 Mar 08 13:40:44.782595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1303/2306] 10.222.0.52 () {60 vars in 1261 bytes} [Tue Mar 8 13:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216902503 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 13:40:45.156107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:45.156752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:45.164128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:45.164582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:45.165487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:45.166134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:45.266238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:45.267220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:45.275072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:45.275529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:45.276557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:45.277023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:45.414459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:45.422568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c468de4e-c1a7-400b-ad07-d98cfb025905 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1302 microversion: 2.1 time: 0.160595 Mar 08 13:40:45.423535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1304/2307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:45 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:40:45.442452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:45.461251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf223e16-5e61-45f1-b81d-380fde4bd156 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.309135 Mar 08 13:40:45.475293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1004/2308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:45 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:46.177277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5aa8fef4-ce3e-4101-b44c-6a768e71b5f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'create', calling method: .version_select at 0x7f5e31faa790>, body: {"keypair": {"name": "tempest-keypair-659459832"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:46.214232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-5aa8fef4-ce3e-4101-b44c-6a768e71b5f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:40:46.225822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-5aa8fef4-ce3e-4101-b44c-6a768e71b5f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for user ced48ea897124de6b874e797b6d74f3d and project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:40:46.440959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:46.443000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:46.458660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:46.462136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:46.463376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:46.464629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:46.680438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-5aa8fef4-ce3e-4101-b44c-6a768e71b5f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:40:46.684952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-5aa8fef4-ce3e-4101-b44c-6a768e71b5f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for user ced48ea897124de6b874e797b6d74f3d and project 500118b8b6da4bba959c36961a149a19. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:40:46.701277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5aa8fef4-ce3e-4101-b44c-6a768e71b5f7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.539045 Mar 08 13:40:46.709516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1305/2309] 10.222.0.52 () {62 vars in 1198 bytes} [Tue Mar 8 13:40:46 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 556 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 13:40:46.716381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:46.717034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:46.724961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:46.725504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:46.726289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:46.726915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:46.860035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:46.868643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-69cbc0dd-3cb3-45da-8ad1-8b4ccb426943 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.431730 Mar 08 13:40:46.869755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1005/2310] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:46 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:46.994516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:47.002682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5870a904-cd87-4876-96ef-ad9c902572c2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.291812 Mar 08 13:40:47.003246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1306/2311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:46 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:47.689623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-891194cf-f5ad-4ee5-8d09-c3248efde867 req-9f4f10ed-1c47-4e42-bc7c-fdd4d80f69dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a602eb3b-374a-47cd-a8e3-ffb9cd421848", "tag": "0d12dcd6-9922-4197-9e56-929dfbd8273d"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:47.699437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-891194cf-f5ad-4ee5-8d09-c3248efde867 req-9f4f10ed-1c47-4e42-bc7c-fdd4d80f69dc service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:47.700083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-891194cf-f5ad-4ee5-8d09-c3248efde867 req-9f4f10ed-1c47-4e42-bc7c-fdd4d80f69dc service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:47.718442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-891194cf-f5ad-4ee5-8d09-c3248efde867 req-9f4f10ed-1c47-4e42-bc7c-fdd4d80f69dc service nova] Creating event network-changed:0d12dcd6-9922-4197-9e56-929dfbd8273d for instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 on hv-cinder-83009 Mar 08 13:40:47.726061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-891194cf-f5ad-4ee5-8d09-c3248efde867 req-9f4f10ed-1c47-4e42-bc7c-fdd4d80f69dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041277 Mar 08 13:40:47.730752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1006/2312] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:40:47.886262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:47.886872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:47.897016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:47.897185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:47.905982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:47.906623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:48.021138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:48.022410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:48.028571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:48.029235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:48.030241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:48.030831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:48.136863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:48.145502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a58d1a37-fae6-4d4a-9ada-fda741a0c9ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.263313 Mar 08 13:40:48.146176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1307/2313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:47 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:48.309306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:48.327577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5ed6d476-6a68-4772-9ed5-f37cc9a7c7ae tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.310667 Mar 08 13:40:48.328970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1007/2314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:48 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:49.162613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:49.163960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:49.169968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:49.170426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:49.171202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:49.171649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:49.315756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:49.324827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0f10b453-3a9f-4a7a-ac0a-e0ac5eb8c862 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.166632 Mar 08 13:40:49.332041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1308/2315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:49 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:49.346039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:49.347157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:49.354861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:49.355368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:49.356782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:49.357229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:49.917728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:49.925674 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6ea3cbe7-20a7-407a-8d1d-647b8b184362 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.584071 Mar 08 13:40:49.926566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1008/2316] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:49 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:50.341893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:50.342508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:50.350652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:50.351101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:50.351878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:50.352310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:50.498965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:50.507635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e25a5e82-db25-49ef-969e-612e2036a2c0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.169800 Mar 08 13:40:50.508387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1309/2317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:50 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:50.741965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1597065379", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d234632-92a1-48cd-bf8f-0912eabcf221"}], "security_groups": [{"name": "tempest-securitygroup--149458162"}], "key_name": "tempest-keypair-659459832", "user_data": "}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:50.839870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.network.neutron [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] validate_networks() for [('7d234632-92a1-48cd-bf8f-0912eabcf221', None, None, None, None, None)] {{(pid=117282) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:40:50.944306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:50.945266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:50.951473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:50.951928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:50.952733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:50.953183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:51.104160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:51.112260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9e9f7404-8f56-458d-a7c6-8f3257a06ed3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.172643 Mar 08 13:40:51.112877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1310/2318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:50 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:40:51.527347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:51.528801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:51.537007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:51.537568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:51.538445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:51.538948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:51.553162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Flavor limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:40:51.553579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Image limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:40:51.554047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Flavor pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:40:51.554461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Image pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:40:51.554837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:40:51.566953 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:51.567564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:51.568482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:51.569164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:51.587500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for project 500118b8b6da4bba959c36961a149a19. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:40:51.591765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Getting quotas for user ced48ea897124de6b874e797b6d74f3d and project 500118b8b6da4bba959c36961a149a19. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:40:51.604632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Going to run 1 instances... {{(pid=117282) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:40:51.607024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:40:51.678906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:51.686643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ae8604eb-18c6-416f-8785-48d1f80e74b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.165816 Mar 08 13:40:51.687205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1311/2319] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:51 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:51.806068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ff3ac1f0-5941-48bb-95b1-8d03061682d0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.069403 Mar 08 13:40:51.812513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1009/2320] 10.222.0.52 () {62 vars in 1187 bytes} [Tue Mar 8 13:40:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 13:40:51.819352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d33b6b5b-a502-487a-8ab6-bd52b585139d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:51.819973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d33b6b5b-a502-487a-8ab6-bd52b585139d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:51.901660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d33b6b5b-a502-487a-8ab6-bd52b585139d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:51.913309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d33b6b5b-a502-487a-8ab6-bd52b585139d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:51.916224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d33b6b5b-a502-487a-8ab6-bd52b585139d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:51.917527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d33b6b5b-a502-487a-8ab6-bd52b585139d tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1281 microversion: 2.20 time: 0.103857 Mar 08 13:40:51.923591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1312/2321] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:51 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:40:52.131739 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:52.132365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:52.140829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:52.141284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:52.142065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:52.142509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:52.305000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:52.313517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-579053bf-4c2a-4e05-b2e0-ec639f1f9b13 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.187212 Mar 08 13:40:52.314255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1010/2322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:52 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:52.703417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:52.704079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:52.711710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:52.712135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:52.712932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:52.713368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:52.858360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:52.868675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9826dbe7-5c83-428a-9993-43fa0020c759 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.169093 Mar 08 13:40:52.869733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1313/2323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:52 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:52.935738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:52.937112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:52.944831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:52.945286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:52.946064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:52.946531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:53.047162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:53.059727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:53.061250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:53.062376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b7d63b07-7f21-490e-b2a2-b593384cc5c6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1285 microversion: 2.20 time: 0.130918 Mar 08 13:40:53.063129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1011/2324] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:52 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:40:53.330810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:53.332405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:53.340408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:53.340899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:53.341687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:53.342140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:53.577986 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:53.581225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-c1fb96d2-9e91-4738-88f8-871c6eeb3f73 req-bf1287d4-9af6-44ac-beae-a9db8adcea27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a602eb3b-374a-47cd-a8e3-ffb9cd421848", "name": "network-vif-plugged", "status": "completed", "tag": "0d12dcd6-9922-4197-9e56-929dfbd8273d"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:53.585847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f0accd9-7320-4309-bec6-b5d6faf08239 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.259020 Mar 08 13:40:53.590064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1314/2325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:53 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:53.590178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-c1fb96d2-9e91-4738-88f8-871c6eeb3f73 req-bf1287d4-9af6-44ac-beae-a9db8adcea27 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:53.590178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-c1fb96d2-9e91-4738-88f8-871c6eeb3f73 req-bf1287d4-9af6-44ac-beae-a9db8adcea27 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:53.601075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-c1fb96d2-9e91-4738-88f8-871c6eeb3f73 req-bf1287d4-9af6-44ac-beae-a9db8adcea27 service nova] Creating event network-vif-plugged:0d12dcd6-9922-4197-9e56-929dfbd8273d for instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 on hv-cinder-83009 Mar 08 13:40:53.606110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-c1fb96d2-9e91-4738-88f8-871c6eeb3f73 req-bf1287d4-9af6-44ac-beae-a9db8adcea27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087071 Mar 08 13:40:53.606699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1012/2326] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:40:53.886405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:53.887013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:53.894389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:53.895117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:53.895836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:53.896307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:54.058128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:54.067841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-60c492f0-44fe-48ff-97ef-6b1beea6c811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.185231 Mar 08 13:40:54.068773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1315/2327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:53 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:54.082664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:54.083355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:54.090170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:54.090909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:54.091776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:54.092464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:54.165432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:54.174621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:54.176688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:54.178552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9543c346-96b2-412f-ac55-514d24eb6496 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1333 microversion: 2.20 time: 0.100442 Mar 08 13:40:54.179212 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1013/2328] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:54 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:40:54.604931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:54.605638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:54.613430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:54.614358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:54.616341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:54.617158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:54.787000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:54.795588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0b220a06-1c2a-419d-8c39-20719d2c9c19 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.195928 Mar 08 13:40:54.796167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1316/2329] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:54 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:40:55.085788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:55.086372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:55.092840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:55.093517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:55.094435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:55.094867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:55.197669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:55.198530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:55.206256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:55.207520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:55.208824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:55.209437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:55.275182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:55.284009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:55.285769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:55.286887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1c0a2e2b-8b0d-4d50-acab-4cbc6bc1c0f3 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1339 microversion: 2.20 time: 0.093303 Mar 08 13:40:55.287448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1317/2330] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:55 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:40:55.298772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:55.306478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-44581e57-46ce-4d55-b2c8-6bc584df357c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1367 microversion: 2.1 time: 0.225152 Mar 08 13:40:55.307213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1014/2331] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:55 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:55.813763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:55.814593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:55.821868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:55.822319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:55.823095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:55.823538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:55.958735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:55.966759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-98c80e1f-930a-4ab6-915b-4f7f084b320f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156864 Mar 08 13:40:55.967328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1318/2332] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:55 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:56.306620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:56.307220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:56.316874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.318259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.319833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.320478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.335743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:56.336371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:56.342403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.343227 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.345125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.345853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.563864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:56.564892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:56.573043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-950f0fb6-157d-44d6-a02e-48c9eda4a99f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1557 microversion: 2.1 time: 0.252305 Mar 08 13:40:56.573668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:56.575159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1319/2333] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:56 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1557 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:56.576059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:56.577085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-26a32610-5094-4540-9862-bbf4b8146ee8 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.275638 Mar 08 13:40:56.588649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1015/2334] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:56 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:40:56.592760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d5d57aa9-60e8-4e91-acfd-3344e8fbc1b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:56.593400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d5d57aa9-60e8-4e91-acfd-3344e8fbc1b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:56.600343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5d57aa9-60e8-4e91-acfd-3344e8fbc1b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.601131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5d57aa9-60e8-4e91-acfd-3344e8fbc1b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.601910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5d57aa9-60e8-4e91-acfd-3344e8fbc1b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.602516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5d57aa9-60e8-4e91-acfd-3344e8fbc1b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.644494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-9a3d7190-9ed8-48ca-bdd5-f6bec77739b4 req-4129be03-6c85-4dee-a8db-ca7f667ecbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7aeeb2-799d-4194-a169-f60c3c630593", "tag": "ba1fa56a-c485-482c-928e-4a0da2c632c4"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:56.653912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-9a3d7190-9ed8-48ca-bdd5-f6bec77739b4 req-4129be03-6c85-4dee-a8db-ca7f667ecbc8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.654351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-9a3d7190-9ed8-48ca-bdd5-f6bec77739b4 req-4129be03-6c85-4dee-a8db-ca7f667ecbc8 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.670846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-9a3d7190-9ed8-48ca-bdd5-f6bec77739b4 req-4129be03-6c85-4dee-a8db-ca7f667ecbc8 service nova] Creating event network-changed:ba1fa56a-c485-482c-928e-4a0da2c632c4 for instance 9a7aeeb2-799d-4194-a169-f60c3c630593 on hv-cinder-83009 Mar 08 13:40:56.680842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-9a3d7190-9ed8-48ca-bdd5-f6bec77739b4 req-4129be03-6c85-4dee-a8db-ca7f667ecbc8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036314 Mar 08 13:40:56.680842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1016/2335] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:40:56.725497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d5d57aa9-60e8-4e91-acfd-3344e8fbc1b0 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137342 Mar 08 13:40:56.728810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1320/2336] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Mar 8 13:40:56 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:40:56.986172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:56.987364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:56.994837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.995612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:56.996965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:56.997479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:57.224826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:57.233987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7b654746-3aaa-4b6c-99ac-60d2437c7cfd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.252930 Mar 08 13:40:57.235056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1017/2337] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:56 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:57.595840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:57.596452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:57.602456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:57.602905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:57.603673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:57.604111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:57.835807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:57.843582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:57.845103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:57.846219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fec5338d-8860-4ce0-b095-60a4c2d7c67a tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.254756 Mar 08 13:40:57.846779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1321/2338] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:57 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:40:57.935665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-72290fce-6eed-43d7-9bf5-f516dd68e234 req-8a46bb9b-25a4-423e-8086-96568f5b415e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a602eb3b-374a-47cd-a8e3-ffb9cd421848", "tag": "0d12dcd6-9922-4197-9e56-929dfbd8273d"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:40:57.945661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-72290fce-6eed-43d7-9bf5-f516dd68e234 req-8a46bb9b-25a4-423e-8086-96568f5b415e service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:57.946105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-72290fce-6eed-43d7-9bf5-f516dd68e234 req-8a46bb9b-25a4-423e-8086-96568f5b415e service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:57.956888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-72290fce-6eed-43d7-9bf5-f516dd68e234 req-8a46bb9b-25a4-423e-8086-96568f5b415e service nova] Creating event network-changed:0d12dcd6-9922-4197-9e56-929dfbd8273d for instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 on hv-cinder-83009 Mar 08 13:40:57.961905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-72290fce-6eed-43d7-9bf5-f516dd68e234 req-8a46bb9b-25a4-423e-8086-96568f5b415e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030202 Mar 08 13:40:57.962555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1018/2339] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:40:58.251650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:58.252546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:58.258798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:58.259511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:58.260537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:58.261184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:58.407066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:58.415560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0de9092d-e804-4083-8e83-24d275c3c9b2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.168108 Mar 08 13:40:58.416140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1322/2340] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:58 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:40:58.864536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:58.865297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:58.871468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:58.871913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:58.872714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:58.873148 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:59.008721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:59.016591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:59.018126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:59.019232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ac6d8561-d30f-4f24-b955-fabb2e1de79c tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.159050 Mar 08 13:40:59.019794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1019/2341] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:40:58 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:40:59.432573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:40:59.433210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:40:59.439434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:59.439878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:59.440624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:40:59.441094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:40:59.572233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:40:59.580236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-30d37261-2d66-40d9-b753-f56476e8165d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151491 Mar 08 13:40:59.580933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1323/2342] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:40:59 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:00.038164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:00.038684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:00.045018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:00.045473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:00.046259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:00.046698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:00.183786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:00.191568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:00.193299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:00.194396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dfddf5ae-f824-43b0-adc3-609023112cf1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.160819 Mar 08 13:41:00.194943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1020/2343] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:41:00 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:41:00.597922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:00.598549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:00.604850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:00.605239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:00.605985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:00.606417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:00.740471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:00.748190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-10b1e405-4293-4dfb-a08c-4de5d1c9cb68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154181 Mar 08 13:41:00.748787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1324/2344] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:00 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:01.212423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:01.213113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:01.219474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:01.219916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:01.220693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:01.221133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:01.352473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:01.360337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:01.361857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:01.362943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6883361a-e06f-41c3-906d-828580f02eb0 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.154621 Mar 08 13:41:01.363498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1021/2345] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:41:01 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:41:01.766255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:01.766897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:01.773964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:01.774416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:01.775185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:01.775621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:01.914555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:01.922292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0855bf41-20e4-4827-842a-463e81818419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159978 Mar 08 13:41:01.922863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1325/2346] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:01 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:02.382882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:02.383481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:02.389421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:02.389863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:02.390618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:02.391050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:02.523208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:02.531026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:02.532529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:02.533693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b57df60-7cb6-4c3b-a6a5-8bcde97afffa tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.155295 Mar 08 13:41:02.534240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1022/2347] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:41:02 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:41:02.939388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:02.939992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:02.946852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:02.956904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:02.956904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:02.956904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:03.088400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:03.096175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bb759ee3-594c-40c9-82c9-4d1df0fad38c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.161221 Mar 08 13:41:03.096751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1326/2348] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:02 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:03.488084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-063925b3-9191-42ae-abda-7bcebf10dfd7 req-ad3d81a4-8e53-4806-8407-2cda1f7e1973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7aeeb2-799d-4194-a169-f60c3c630593", "name": "network-vif-plugged", "status": "completed", "tag": "ba1fa56a-c485-482c-928e-4a0da2c632c4"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:41:03.497218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-063925b3-9191-42ae-abda-7bcebf10dfd7 req-ad3d81a4-8e53-4806-8407-2cda1f7e1973 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:03.497666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-063925b3-9191-42ae-abda-7bcebf10dfd7 req-ad3d81a4-8e53-4806-8407-2cda1f7e1973 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:03.508527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-063925b3-9191-42ae-abda-7bcebf10dfd7 req-ad3d81a4-8e53-4806-8407-2cda1f7e1973 service nova] Creating event network-vif-plugged:ba1fa56a-c485-482c-928e-4a0da2c632c4 for instance 9a7aeeb2-799d-4194-a169-f60c3c630593 on hv-cinder-83009 Mar 08 13:41:03.513573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-063925b3-9191-42ae-abda-7bcebf10dfd7 req-ad3d81a4-8e53-4806-8407-2cda1f7e1973 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029496 Mar 08 13:41:03.514240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1023/2349] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:41:03.552232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:03.552918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:03.559770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:03.560225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:03.561116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:03.561556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:03.696755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:03.704609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:03.706233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:03.707341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b490350d-4960-4bc9-a45f-d996f7f051b6 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.159820 Mar 08 13:41:03.707995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1327/2350] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:41:03 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:41:04.114913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:04.115606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:04.121626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:04.122086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:04.123839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:04.123839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:04.256550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:04.264453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7ffec985-f558-4e2f-ba0b-e17c51d3a52e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153714 Mar 08 13:41:04.265037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1024/2351] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:04 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:04.725296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:04.725908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:04.732341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:04.732845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:04.733616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:04.734056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:04.871878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:04.880358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:04.882287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:04.883400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8340b037-4196-4aac-813d-93b2e87941d4 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1406 microversion: 2.20 time: 0.162032 Mar 08 13:41:04.883968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1328/2352] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:41:04 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:41:05.282495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:05.283071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:05.289985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:05.290430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:05.291191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:05.291699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:05.430331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:05.438205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-00d289ec-f292-40c3-b5b8-31cd0c58d19e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159724 Mar 08 13:41:05.439549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1025/2353] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:05 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:05.900760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:05.901362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:05.907589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:05.908034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:05.908815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:05.909249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:06.039389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:06.046994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:06.048494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:06.049677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9cba8dc4-8ceb-4845-9d91-1856e40e6e0e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1597 microversion: 2.20 time: 0.152826 Mar 08 13:41:06.050231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1329/2354] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:41:05 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:41:06.067566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-395ecfc7-86db-4fb8-bb26-63f53daf26ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:06.068153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-395ecfc7-86db-4fb8-bb26-63f53daf26ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:06.074039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-395ecfc7-86db-4fb8-bb26-63f53daf26ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:06.074487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-395ecfc7-86db-4fb8-bb26-63f53daf26ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:06.075248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-395ecfc7-86db-4fb8-bb26-63f53daf26ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:06.075684 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-395ecfc7-86db-4fb8-bb26-63f53daf26ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:06.156390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-395ecfc7-86db-4fb8-bb26-63f53daf26ed tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093118 Mar 08 13:41:06.157007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1026/2355] 10.222.0.52 () {60 vars in 1315 bytes} [Tue Mar 8 13:41:06 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:41:06.455264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:06.455903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:06.463132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:06.463581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:06.464350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:06.464814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:06.598430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:06.606865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9c91024b-c9da-4200-8596-d163f7256912 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155332 Mar 08 13:41:06.607451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1330/2356] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:06 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:07.455683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-ca31d614-421c-465c-b133-1b7d3f160211 req-b5ef682d-0299-4b2d-8530-b3d907d609fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a7aeeb2-799d-4194-a169-f60c3c630593", "tag": "ba1fa56a-c485-482c-928e-4a0da2c632c4"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:41:07.464435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-ca31d614-421c-465c-b133-1b7d3f160211 req-b5ef682d-0299-4b2d-8530-b3d907d609fd service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:07.465042 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-ca31d614-421c-465c-b133-1b7d3f160211 req-b5ef682d-0299-4b2d-8530-b3d907d609fd service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:07.476960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-ca31d614-421c-465c-b133-1b7d3f160211 req-b5ef682d-0299-4b2d-8530-b3d907d609fd service nova] Creating event network-changed:ba1fa56a-c485-482c-928e-4a0da2c632c4 for instance 9a7aeeb2-799d-4194-a169-f60c3c630593 on hv-cinder-83009 Mar 08 13:41:07.482175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-ca31d614-421c-465c-b133-1b7d3f160211 req-b5ef682d-0299-4b2d-8530-b3d907d609fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030596 Mar 08 13:41:07.483050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1027/2357] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:41:07.625151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:07.625683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:07.632280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:07.632772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:07.633550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:07.633988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:07.775238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:07.783101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dbe7f265-a2f2-4abd-acee-73d35ec90b90 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.161788 Mar 08 13:41:07.784003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1331/2358] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:07 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:08.801575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:08.802296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:08.808974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:08.809419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:08.810181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:08.810619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:08.946793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:08.954574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-93b42f9d-e290-4044-8ae9-f4908a43d251 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157212 Mar 08 13:41:08.955134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1028/2359] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:08 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:41:09.972138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:09.972813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:09.979812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:09.980263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:09.981071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:09.981507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:10.117816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:10.125926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54907a35-80f7-4dcf-8f6f-68667b9f30f2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157636 Mar 08 13:41:10.126570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1332/2360] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:09 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:11.146927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:11.147533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:11.153771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:11.154217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:11.154976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:11.155407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:11.286683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:11.294603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fbaaa401-420f-4713-97f5-d1f0d025a3f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152224 Mar 08 13:41:11.295306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1029/2361] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:11 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:12.311376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:12.312022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:12.318792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:12.319246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:12.320022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:12.320463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:12.455467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:12.464301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3f3c1be3-2f80-4668-be27-169d5eb593ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156952 Mar 08 13:41:12.464902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1333/2362] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:12 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:13.481366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:13.481900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:13.488409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:13.488896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:13.489659 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:13.490103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:13.620582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:13.629290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea1272a9-1c47-4fbb-8d08-210752810108 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151805 Mar 08 13:41:13.629984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1030/2363] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:13 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:14.647417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:14.648028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:14.654412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:14.654869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:14.655631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:14.656069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:14.789494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:14.797295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f528fed3-bfc3-4213-aa90-a23f858bce5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154315 Mar 08 13:41:14.797865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1334/2364] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:14 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:15.814231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:15.814829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:15.821289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:15.821734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:15.822490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:15.822941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:15.954769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:15.963167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fa842363-9c4a-46b1-b0cd-0d5fe91f4893 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152748 Mar 08 13:41:15.963715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1031/2365] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:15 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:16.981792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:16.982438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:16.988814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:16.993296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:16.993296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:16.993296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:17.121471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:17.129531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f8658f3c-1c99-452e-bb94-545904a45881 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152997 Mar 08 13:41:17.130102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1335/2366] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:16 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:18.146857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:18.147526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:18.154312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:18.154755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:18.155506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:18.155936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:18.292878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:18.300832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cf1e058a-ee39-4892-afd9-cef88ed50384 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157718 Mar 08 13:41:18.301373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1032/2367] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:18 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:19.318140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:19.318784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:19.325193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:19.325640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:19.326403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:19.326840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:19.460954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:19.468859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3966a092-7168-4d94-b6fe-de70bd2e9737 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154629 Mar 08 13:41:19.469431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1336/2368] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:19 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:20.486730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:20.487341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:20.494402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:20.494848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:20.495603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:20.496033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:20.631962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:20.640475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-28de63ad-d1b4-48c8-9b51-b4a289ae027e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157803 Mar 08 13:41:20.641064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1033/2369] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:20 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:21.657602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:21.658218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:21.664460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:21.664939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:21.665696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:21.666219 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:21.799841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:21.808311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-69a8c755-887f-4900-845f-e6f1fc9bf09e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154494 Mar 08 13:41:21.808914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1337/2370] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:21 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:22.825320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:22.825925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:22.832110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:22.832553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:22.833351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:22.833780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:22.966805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:22.974439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-60329fa0-5ca2-4e03-8c03-55a9e99526d7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153477 Mar 08 13:41:22.974991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1034/2371] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:22 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:23.991835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:23.992444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:23.999484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:23.999935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:24.000738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:24.001179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:24.141283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:24.151550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3722e5e8-642b-4195-b3c3-5809d84841e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.163369 Mar 08 13:41:24.152277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1338/2372] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:23 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:25.169832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:25.170412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:25.176755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:25.184074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:25.184074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:25.184074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:25.321825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:25.329752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7e82d043-0928-4368-8009-6b5cbecffbb0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.164394 Mar 08 13:41:25.330317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1035/2373] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:25 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:26.346655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:26.347323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:26.353636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:26.354091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:26.354861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:26.355306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:26.485442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:26.493194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-67eb6331-c3fb-4071-8ac4-00417a77e746 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150488 Mar 08 13:41:26.493765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1339/2374] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:26 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:27.511321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:27.511928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:27.518247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:27.518700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:27.519461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:27.519897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:27.653059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:27.660798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b1c299ee-f76c-49cc-87de-1f9ea2a594f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153887 Mar 08 13:41:27.661360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1036/2375] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:27 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:28.677825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:28.678435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:28.685280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:28.685726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:28.686476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:28.686909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:28.817811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:28.826115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-17ca5a23-e989-49b9-a425-da249e33768f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152132 Mar 08 13:41:28.826676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1340/2376] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:28 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:29.843133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:29.843746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:29.850006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:29.850460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:29.851235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:29.851672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:29.983705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:29.991804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-33f3066c-092a-4aff-bc98-fa540d7f91bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152565 Mar 08 13:41:29.992353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1037/2377] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:29 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:31.008716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:31.009367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:31.016234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:31.016715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:31.017489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:31.017931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:31.148933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:31.156816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5359ba10-4b84-462d-b735-d9670d951533 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151867 Mar 08 13:41:31.157388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1341/2378] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:31 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:32.174293 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:32.174903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:32.180882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:32.185554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:32.185554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:32.185554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:32.316904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:32.325446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-98a5627f-85c0-458f-a3df-ee77e2c8ed0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154905 Mar 08 13:41:32.326009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1038/2379] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:32 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:33.599486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:33.600040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:33.606406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:33.606860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:33.607629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:33.608072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:33.737517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:33.745877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-22a488bd-790e-43e8-b836-a38ccab9d669 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.407228 Mar 08 13:41:33.746437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1342/2380] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:33 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:33.864105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-26ee8eae-08e2-406f-8052-341538921f27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:33.864627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-26ee8eae-08e2-406f-8052-341538921f27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:33.870836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26ee8eae-08e2-406f-8052-341538921f27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:33.871286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26ee8eae-08e2-406f-8052-341538921f27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:33.872056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26ee8eae-08e2-406f-8052-341538921f27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:33.872490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26ee8eae-08e2-406f-8052-341538921f27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:33.895413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-26ee8eae-08e2-406f-8052-341538921f27 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848/ips" status: 200 len: 150 microversion: 2.1 time: 0.035236 Mar 08 13:41:33.895966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1039/2381] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:41:33 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:41:34.763785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:34.764455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:34.770614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:34.771065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:34.771813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:34.772247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:34.905940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:34.913757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cae72e45-eb9d-4a42-89d0-7b3104d7c76d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154366 Mar 08 13:41:34.914326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1343/2382] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:34 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:35.931198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:35.931829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:35.938092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:35.938536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:35.939284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:35.939712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:36.070331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:36.078768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-560b3f26-d5b8-491c-b2bc-34db89d6dd91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151408 Mar 08 13:41:36.079314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1040/2383] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:35 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:37.095574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:37.096211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:37.102540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:37.102982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:37.103737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:37.104171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:37.238483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:37.246246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-07d4320d-8f4c-4801-99f6-194298f4ce99 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154532 Mar 08 13:41:37.246904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1344/2384] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:37 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:38.264163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:38.264821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:38.271628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:38.272081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:38.272895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:38.273328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:38.414471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:38.422318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fd8c7ef1-0fb4-417c-b2ef-1fcbe3d2fec6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.162848 Mar 08 13:41:38.422880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1041/2385] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:38 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:39.439288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:39.439889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:39.446147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:39.446605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:39.447351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:39.448294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:39.595934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:39.603978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-581c1632-7c80-45e5-8aa1-5ecd72512503 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.168498 Mar 08 13:41:39.615298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1345/2386] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:39 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:40.623011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:40.623620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:40.630003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:40.630450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:40.631205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:40.631635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:40.772309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:40.780946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f1ae5129-c009-4796-a3aa-9e23aee4d534 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.161761 Mar 08 13:41:40.781518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1042/2387] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:40 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:41.798816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:41.799496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:41.806139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:41.806667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:41.808211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:41.808680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:41.945748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:41.953969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ae04c32e-eea2-4c92-b298-8180147f2433 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159177 Mar 08 13:41:41.954536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1346/2388] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:41 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:42.973109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:42.974007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:42.982279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:42.982878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:42.983916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:42.984868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:43.118215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:43.127403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e8200e92-2a7d-4fbd-822d-9aae7c429ac9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159533 Mar 08 13:41:43.128000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1043/2389] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:43.388611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-af2b34a2-5fda-4708-9e58-7096a6123409 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:43.389124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-af2b34a2-5fda-4708-9e58-7096a6123409 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:43.395502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af2b34a2-5fda-4708-9e58-7096a6123409 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:43.395953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af2b34a2-5fda-4708-9e58-7096a6123409 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:43.396845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af2b34a2-5fda-4708-9e58-7096a6123409 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:43.397298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af2b34a2-5fda-4708-9e58-7096a6123409 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:43.419974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-af2b34a2-5fda-4708-9e58-7096a6123409 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593/ips" status: 200 len: 151 microversion: 2.20 time: 0.035371 Mar 08 13:41:43.420540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1347/2390] 10.222.0.52 () {60 vars in 1288 bytes} [Tue Mar 8 13:41:43 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 13:41:44.144940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:44.145543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:44.152476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:44.153009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:44.153754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:44.154188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:44.291269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:44.299067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a662a35d-54aa-44fa-9b14-b16ad8e129ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158089 Mar 08 13:41:44.299688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1044/2391] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:44 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:45.317399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:45.317953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:45.324944 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:45.325396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:45.326166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:45.326611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:45.455764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:45.464121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1eae510b-5620-42cf-9b62-419284b33833 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150249 Mar 08 13:41:45.464815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1348/2392] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:45 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:46.480941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:46.481547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:46.488023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:46.488472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:46.489270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:46.489704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:46.621792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:46.629446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1aeb323e-6a7b-4215-a714-49ac42cb6df1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153023 Mar 08 13:41:46.629999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1045/2393] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:46 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:47.646937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:47.647516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:47.654567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:47.655015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:47.655774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:47.656207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:47.792498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:47.800232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77a23c6f-89de-4ae2-8598-53c82decf3ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157256 Mar 08 13:41:47.800818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1349/2394] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:47 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:48.817566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:48.818122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:48.824287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:48.824766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:48.825518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:48.825951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:48.959328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:48.967732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bd028280-3e33-4aff-ae29-fea07763934d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154121 Mar 08 13:41:48.968289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1046/2395] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:48 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:49.985324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:49.985965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:49.992225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:49.992687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:49.993454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:49.993885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:50.122949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:50.130633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cf7b848e-638c-4227-9cf4-70af191c9049 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149535 Mar 08 13:41:50.131197 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1350/2396] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:49 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:51.147274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:51.147874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:51.154724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:51.155170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:51.155926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:51.156353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:51.299679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:51.307717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-59c1f667-a868-490f-aeff-9b9f9ba368bb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.164293 Mar 08 13:41:51.308283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1047/2397] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:51 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:52.326813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:52.327384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:52.333894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:52.334320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:52.335082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:52.335513 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:52.473856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:52.481639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e99f56d4-374e-460d-a35a-a90a05217f58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159464 Mar 08 13:41:52.482193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1351/2398] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:52 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:53.498479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:53.499091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:53.505314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:53.505771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:53.506532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:53.506967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:53.640359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:53.648185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b6b65a5-135b-4ae1-927c-3ad06dc8d888 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153497 Mar 08 13:41:53.648766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1048/2399] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:53 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:54.666314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:54.666876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:54.673248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:54.673695 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:54.674461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:54.674898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:54.805720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:54.817820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-47a0a0e9-b412-4376-987c-9f8e6d87f776 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155545 Mar 08 13:41:54.818396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1352/2400] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:54 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:55.835447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:55.836072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:55.842940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:55.843388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:55.844135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:55.844565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:55.977231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:55.985180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-359cee48-f0da-472c-b448-2e74b33b3bd1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153585 Mar 08 13:41:55.985728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1049/2401] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:55 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:57.002422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:57.003023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:57.009507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:57.009951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:57.010704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:57.011133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:57.143915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:57.151644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ff163d02-0793-42d5-bb6f-c52cea9d517f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153346 Mar 08 13:41:57.152210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1353/2402] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:56 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:58.168745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:58.169497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:58.176225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:58.176690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:58.177464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:58.177902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:58.309475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:58.317150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-179349ca-da7b-44c1-8a50-af5ad9f6f375 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152318 Mar 08 13:41:58.317713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1050/2403] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:58 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:41:59.335243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:41:59.335845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:41:59.342107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:59.342584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:59.343878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:41:59.344402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:41:59.474432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:41:59.482177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f0ab14d7-aae6-4e8f-9dd7-061edd018f27 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150846 Mar 08 13:41:59.482741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1354/2404] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:41:59 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:00.499310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:00.499924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:00.506443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:00.506897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:00.507672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:00.508109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:00.644826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:00.652530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-89b67831-e60d-4d8b-9ba2-f92a1dc90b58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157068 Mar 08 13:42:00.653120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1051/2405] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:00 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:01.669781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:01.670329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:01.677242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:01.677697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:01.678492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:01.678937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:01.810660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:01.818597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3432c87b-7454-43a7-8887-15cd8788aa28 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152730 Mar 08 13:42:01.819159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1355/2406] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:01 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:42:02.843608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:02.843608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:02.843608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:02.844215 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:02.844840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:02.845277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:02.981516 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:02.990260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1e4683de-0fc5-4efc-b1da-39213a20ddd6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157349 Mar 08 13:42:02.990813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1052/2407] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:02 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:04.007689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:04.008300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:04.014466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:04.014915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:04.015674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:04.016114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:04.151368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:04.159109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4fc64b32-8157-4da7-87cf-4dc020946acf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155138 Mar 08 13:42:04.159681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1356/2408] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:04 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:05.176065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:05.176824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:05.183050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:05.183496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:05.184251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:05.184740 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:05.319734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:05.328967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f9e7e7a-8e95-4e56-b269-f3fc4fde3dbb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157505 Mar 08 13:42:05.329539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1053/2409] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:05 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:42:06.348907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:06.349555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:06.355690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:06.356150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:06.356945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:06.357385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:06.488696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:06.496372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-613f259a-6577-401e-99a3-764493f296b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152156 Mar 08 13:42:06.496956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1357/2410] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:06 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:07.513990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:07.514630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:07.521787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:07.522232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:07.522993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:07.523424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:07.656605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:07.664860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f50d7d1c-4a76-4431-956d-fb5cb786f923 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154781 Mar 08 13:42:07.665417 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1054/2411] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:07 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:08.682450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:08.683060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:08.689328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:08.689783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:08.690552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:08.691645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:08.822554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:08.830312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-decd7e5a-9003-46f0-9cef-7a21f3f2203e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151814 Mar 08 13:42:08.830878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1358/2412] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:08 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:09.847968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:09.848580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:09.854857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:09.855307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:09.856072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:09.856507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:09.994086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:10.002311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d53d4908-43b4-4c14-ba1c-db654cb6338b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158540 Mar 08 13:42:10.003087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1055/2413] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:09 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:11.021170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:11.021781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:11.028061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:11.028508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:11.029358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:11.029794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:11.160585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:11.168257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c8055096-4ad7-4450-ab2b-a4780f7ad200 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151573 Mar 08 13:42:11.168850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1359/2414] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:11 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:12.185632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:12.187463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:12.192495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:12.193010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:12.193761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:12.194193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:12.333268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:12.341306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-94aee006-3fad-4ff3-80d7-19ed11ad1824 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159523 Mar 08 13:42:12.342092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1056/2415] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:12 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:42:13.359325 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:13.359942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:13.370969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:13.371425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:13.372382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:13.372642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:13.504594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:13.512245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4ea5de30-2e93-4dea-a4e4-921fd293cf72 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156985 Mar 08 13:42:13.512836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1360/2416] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:13 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:14.528860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:14.529481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:14.536596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:14.537083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:14.537849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:14.538290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:14.667601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:14.675396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7f287231-e340-4d7e-8c4f-3116750df2ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150449 Mar 08 13:42:14.676074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1057/2417] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:14 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:15.692555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:15.693194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:15.699060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:15.699504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:15.700254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:15.700710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:15.831193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:15.839768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-81785666-2987-4ae6-9668-58d7efd135f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151436 Mar 08 13:42:15.840327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1361/2418] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:15 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:16.857524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:16.858128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:16.865373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:16.865816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:16.866568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:16.866999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:17.010137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:17.017954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-282a30fe-6454-469f-9042-dec05b781094 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.164292 Mar 08 13:42:17.018512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1058/2419] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:16 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:18.034269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:18.035331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:18.043167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:18.043622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:18.044394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:18.044870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:18.176962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:18.184949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b6990884-4c8c-425f-928c-7ebd80479cb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154501 Mar 08 13:42:18.190241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1362/2420] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:18 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:19.202949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:19.203590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:19.210842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:19.211285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:19.212033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:19.212463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:19.344897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:19.353080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7bb4034a-c2bd-4984-9b9a-a8155b3cbe33 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153904 Mar 08 13:42:19.353590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1059/2421] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:19 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:20.370615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:20.371232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:20.377465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:20.377907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:20.378657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:20.379090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:20.514333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:20.522607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1dafcd2e-9d3c-41f4-bcb3-19a04f632922 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155864 Mar 08 13:42:20.523181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1363/2422] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:20 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:21.539908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:21.540510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:21.547020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:21.547467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:21.548223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:21.548670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:21.683497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:21.691312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a454fb56-ff28-4965-bc18-608089cc7b37 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155301 Mar 08 13:42:21.691954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1060/2423] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:21 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:22.708993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:22.709599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:22.715583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:22.716028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:22.716848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:22.717293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:22.855583 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:22.864279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-df3280c0-3e14-4ae9-a7fa-f956590a5f2d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159369 Mar 08 13:42:22.864862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1364/2424] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:22 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:23.881411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:23.882026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:23.888175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:23.888626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:23.889426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:23.889869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:24.019388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:24.027714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aec6e600-5d6d-4b87-82a8-7a28e03bceac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150590 Mar 08 13:42:24.028270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1061/2425] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:23 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:25.045000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:25.045561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:25.051832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:25.052290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:25.053063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:25.053500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:25.194419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:25.202520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-466eeb77-f409-4439-9381-4c28a9efbfe7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.161464 Mar 08 13:42:25.203094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1365/2426] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:25 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:26.220123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:26.220723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:26.227110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:26.227563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:26.228328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:26.228802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:26.365748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:26.373569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-46c388e4-f8ec-4f76-a6ed-f60895848802 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157471 Mar 08 13:42:26.374142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1062/2427] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:26 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:27.391133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:27.391852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:27.398525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:27.398972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:27.399732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:27.400165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:27.530039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:27.538169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b2573f25-9f94-4f84-9844-3bc1955526cc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150851 Mar 08 13:42:27.538732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1366/2428] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:27 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:28.555515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:28.556122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:28.562394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:28.562820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:28.563581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:28.564015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:28.698560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:28.706284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-49e6902f-4e14-49c8-99c8-2dd0234b7774 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155139 Mar 08 13:42:28.706838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1063/2429] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:28 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:29.723947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:29.724550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:29.730910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:29.731357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:29.732104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:29.732538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:29.861236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:29.869797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1a062a73-a829-4950-b573-2275ddf15174 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149768 Mar 08 13:42:29.870367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1367/2430] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:29 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:30.886674 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:30.887286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:30.893715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:30.894157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:30.894939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:30.895373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:31.025960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:31.033618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-80f99998-b507-4540-966e-9933af0efd12 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151453 Mar 08 13:42:31.034167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1064/2431] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:30 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:32.051269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:32.051859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:32.058905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:32.059354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:32.060114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:32.060551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:32.196419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:32.204716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bd85e64f-cc14-4df8-bd8e-89a4e1dc5b89 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157260 Mar 08 13:42:32.205289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1368/2432] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:32 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:42:33.221821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:33.225342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:33.228640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:33.229114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:33.229927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:33.230360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:33.369917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:33.377829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-639a1aa9-4bd7-4e79-9ea6-62406a77008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159933 Mar 08 13:42:33.378389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1065/2433] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:33 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:34.395120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:34.395758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:34.402291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:34.402740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:34.404046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:34.404894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:34.546527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:34.554716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-926d90f4-4509-467e-93e9-8f324a2cb9cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.163331 Mar 08 13:42:34.555330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1369/2434] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:34 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:35.571928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:35.572520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:35.578688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:35.579133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:35.579889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:35.580321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:35.712003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:35.719715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-448cdc5d-0275-40a1-bffc-dd3f13e639f3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152267 Mar 08 13:42:35.720269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1066/2435] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:35 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:36.737251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:36.737835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:36.744063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:36.744506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:36.745288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:36.745720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:37.118037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:37.125728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c9375f5e-3dc8-4ff1-bb84-ba75ebc7f05d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.392653 Mar 08 13:42:37.126294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1370/2436] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:36 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:38.143629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:38.144231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:38.151224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:38.151668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:38.152421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:38.152877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:38.282233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:38.289960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b4387758-ca70-4458-a851-62cc21f2ef2c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150333 Mar 08 13:42:38.290513 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1067/2437] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:38 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:39.307597 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:39.308201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:39.314519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:39.314971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:39.315728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:39.316168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:39.448108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:39.455783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-91e04509-44de-4603-b9a1-a43df7eaeb35 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152695 Mar 08 13:42:39.456349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1371/2438] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:39 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:39.873868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:42:39.874096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:42:40.472362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:40.473004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:40.479947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:40.480394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:40.481193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:40.481633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:40.620555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:40.629105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-439c7cba-7998-46b7-9ffb-3c5394cda628 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.160528 Mar 08 13:42:40.629670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1068/2439] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:40 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:41.646464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:41.647056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:41.653596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:41.654159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:41.654825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:41.655299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:41.797515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:41.805241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c28068d7-a7d1-4796-ac24-8044175c3921 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.162638 Mar 08 13:42:41.805837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1372/2440] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:41 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:42.823576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:42.824222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:42.830415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:42.830845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:42.831600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:42.832030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:42.965630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:42.973500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a5e7195-8cf0-4b2f-b440-78b76c086857 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154386 Mar 08 13:42:42.974066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1069/2441] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:43.990405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:43.991013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:43.997517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:43.997989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:43.998711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:43.999135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:44.130951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:44.139523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-52f58fbd-e2e4-44db-83fb-0cdbf1f1a5ce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152904 Mar 08 13:42:44.140093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1373/2442] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:43 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:45.157403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:45.157976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:45.164255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:45.164857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:45.165622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:45.167141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:45.303820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:45.311951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f5cb59b8-fe62-4aa1-a56a-9aedd55ef1f1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158448 Mar 08 13:42:45.312531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1070/2443] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:45 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:46.329372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:46.329981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:46.335912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:46.336360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:46.337153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:46.337588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:46.475827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:46.484846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-70ae414b-d7aa-4391-b8f2-03c77c98b05b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159650 Mar 08 13:42:46.485406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1374/2444] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:46 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:47.501982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:47.502895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:47.509216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:47.509754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:47.511083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:47.511518 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:47.657502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:47.665394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-403d9532-d9cd-44bc-930c-796b8f60b084 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.167460 Mar 08 13:42:47.666467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1071/2445] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:47 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:48.683580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:48.684218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:48.690618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:48.691097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:48.691846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:48.692276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:48.834003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:48.841927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-14dfab2d-7ce6-4f7a-bc41-f9f5e41204b5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.163026 Mar 08 13:42:48.842528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1375/2446] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:48 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:49.860946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:49.861643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:49.867943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:49.868387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:49.869402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:49.869894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:50.008015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:50.019008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0d387167-f2b2-4125-b84f-3e4a17b03501 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.162795 Mar 08 13:42:50.019617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1072/2447] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:49 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:51.036150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:51.036798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:51.044059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:51.044683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:51.045472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:51.045919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:51.192525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:51.201653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1814a821-367f-4867-b3e5-837d6b5dffab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.169229 Mar 08 13:42:51.204190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1376/2448] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:51 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:52.219399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:52.220047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:52.226365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:52.226818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:52.227583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:52.228026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:52.371023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:52.379235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-04f47d50-1d1a-4be9-a084-2ca858071274 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.163795 Mar 08 13:42:52.379795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1073/2449] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:52 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:42:53.395398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:53.395954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:53.402365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:53.402811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:53.403570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:53.404013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:53.547776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:53.555943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1999c03d-d35e-4bec-b30d-408a92c25211 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.164478 Mar 08 13:42:53.556525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1377/2450] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:53 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:54.573825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:54.574433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:54.580640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:54.581114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:54.581872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:54.582304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:54.712631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:54.720506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-96a8c41e-b13c-40f8-b754-6c7d0d9920e0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151180 Mar 08 13:42:54.721086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1074/2451] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:54 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:55.738049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:55.738679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:55.745372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:55.745815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:55.746568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:55.746998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:55.878963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:55.887664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b164ed20-f9b5-4543-b795-2838c39a57c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153769 Mar 08 13:42:55.888227 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1378/2452] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:55 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:56.905444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:56.906048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:56.912322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:56.912804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:56.913558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:56.913989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:57.050826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:57.058609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ff860630-5162-4514-bb86-e496c4718896 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157550 Mar 08 13:42:57.059290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1075/2453] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:56 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:58.076088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:58.076703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:58.082894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:58.083341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:58.084089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:58.084523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:58.217968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:58.225983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8301e367-c633-482c-9878-937db9155e91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154037 Mar 08 13:42:58.226609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1379/2454] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:58 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:42:59.243818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:42:59.244437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:42:59.251343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:59.251787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:59.252539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:42:59.252999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:42:59.385113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:42:59.393480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d762eebe-d937-49b5-8060-19b4bd96c278 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153476 Mar 08 13:42:59.394036 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1076/2455] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:42:59 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:00.410347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:00.410955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:00.417206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:00.417657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:00.418413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:00.418849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:00.550515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:00.563973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a7dbdaab-b32b-40cb-b193-e99e4298ccc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157448 Mar 08 13:43:00.568029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1380/2456] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:00 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:01.588029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:01.589247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:01.595345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:01.595792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:01.596547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:01.597004 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:01.733044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:01.740949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1f0e50d0-a007-481d-8002-bb6135d605b0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156659 Mar 08 13:43:01.741502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1077/2457] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:01 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:02.758156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:02.758764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:02.765649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:02.766103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:02.766866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:02.767308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:02.905186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:02.912852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b0037fa2-b5a9-4b0d-b69e-369ecf3697ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158544 Mar 08 13:43:02.913413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1381/2458] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:02 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:03.929917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:03.930572 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:03.937901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:03.938353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:03.939157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:03.939597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:04.072191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:04.080030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-59132ae3-df68-441f-86e0-3d52ab0191a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153942 Mar 08 13:43:04.080588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1078/2459] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:03 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:05.097107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:05.097714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:05.104183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:05.104679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:05.106350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:05.106785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:05.241426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:05.249431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7c013b09-f694-42f0-bcbc-3f236a80e171 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156668 Mar 08 13:43:05.250003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1382/2460] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:05 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:06.267510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:06.268103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:06.274395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:06.274838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:06.275589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:06.276050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:06.405473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:06.413080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7a0a3b98-a1bc-49ea-9313-3162971121ea tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149635 Mar 08 13:43:06.413627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1079/2461] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:06 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:07.430838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:07.431449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:07.438638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:07.439086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:07.439858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:07.440292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:07.577580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:07.585479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f950d393-63aa-4a4f-82e4-36928c4ab208 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158496 Mar 08 13:43:07.586050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1383/2462] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:07 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:08.603191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:08.603712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:08.611003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:08.611449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:08.612198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:08.612679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:08.742601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:08.750496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2175eb98-97b2-4a58-af3e-3d5343ec008c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151226 Mar 08 13:43:08.751054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1080/2463] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:08 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:09.767533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:09.768147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:09.774431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:09.774878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:09.775636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:09.776073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:09.909803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:09.917787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2832e7c4-cfaf-46aa-a927-1160ceb56050 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154303 Mar 08 13:43:09.918539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1384/2464] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:09 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:10.934860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:10.935465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:10.941664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:10.942110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:10.942862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:10.943294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:11.087854 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:11.096236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c48da038-174f-43e8-909b-48a89fa0eac4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.165136 Mar 08 13:43:11.096825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1081/2465] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:10 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:43:12.114559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:12.115176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:12.123863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:12.124316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:12.125344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:12.125838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:12.260136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:12.268404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fd83de95-38bb-4a68-9cd0-f1982e33fc0f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158906 Mar 08 13:43:12.268994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1385/2466] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:12 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:13.285059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:13.285896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:13.291904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:13.292389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:13.293145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:13.293560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:13.428876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:13.436542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a7a2b1d6-0a34-4ee2-a585-52b934d0a79e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155975 Mar 08 13:43:13.437133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1082/2467] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:13 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:43:14.452964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:14.453580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:14.460397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:14.460887 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:14.461657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:14.462100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:14.598456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:14.606288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d46527b1-7e39-44bf-9463-445d75a0484d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157165 Mar 08 13:43:14.606783 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1386/2468] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:14 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:15.623549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:15.624142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:15.630654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:15.631108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:15.631862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:15.632295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:15.761767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:15.770615 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5ce35383-fb9e-496e-9852-5e10f080c863 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150876 Mar 08 13:43:15.771178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1083/2469] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:15 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:16.788205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:16.788817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:16.794967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:16.795412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:16.796186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:16.796642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:16.924037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:16.931743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-63886421-14c3-439d-8355-7f519033c567 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.147439 Mar 08 13:43:16.932300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1387/2470] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:16 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:17.949038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:17.949628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:17.955859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:17.956414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:17.957202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:17.957637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:18.089723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:18.098002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c048b296-e74e-4758-81a7-432610eabd68 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152807 Mar 08 13:43:18.098562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1084/2471] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:17 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:19.115313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:19.115924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:19.122211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:19.122665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:19.123424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:19.123862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:19.257212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:19.264976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-04e7009f-38ab-486f-8f7e-db7b585459de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154098 Mar 08 13:43:19.265547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1388/2472] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:19 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:20.282382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:20.282985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:20.289443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:20.289883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:20.290638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:20.291059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:20.423512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:20.431714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-47f6853b-ff6f-48b6-a0aa-282ba1efab5e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153260 Mar 08 13:43:20.432265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1085/2473] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:20 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:21.449026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:21.449681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:21.456293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:21.456788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:21.457558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:21.458221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:21.601036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:21.608973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-51a42bd8-955e-4b29-a0bf-7e90505b5987 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.163649 Mar 08 13:43:21.609540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1389/2474] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:21 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:22.625423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:22.625961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:22.632407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:22.632891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:22.633650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:22.634094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:22.762289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:22.770678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2e6b13fc-fb65-4f79-9fc9-cb662d98cb98 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149185 Mar 08 13:43:22.771247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1086/2475] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:22 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:23.787991 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:23.788601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:23.794860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:23.795310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:23.796064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:23.796502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:23.927716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:23.935452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a95a6aab-371a-438d-997c-63e3799e57d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151786 Mar 08 13:43:23.936006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1390/2476] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:23 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:24.952371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:24.953008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:24.959355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:24.960083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:24.960877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:24.961340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:25.094576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:25.102515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e3c3b9dd-db57-4c88-9211-3a77bee3304c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153955 Mar 08 13:43:25.103077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1087/2477] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:24 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:26.120396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:26.121052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:26.128566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:26.129067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:26.129839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:26.130280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:26.264330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:26.272956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-921f6b08-7986-41e2-8209-257987ea4fab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156401 Mar 08 13:43:26.273530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1391/2478] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:26 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:27.290524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:27.291133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:27.297427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:27.297875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:27.298631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:27.299066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:27.427435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:27.435123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-73267eb7-0dd1-448d-a57c-c48e36fcda43 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.148415 Mar 08 13:43:27.435680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1088/2479] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:27 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:28.453730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:28.454376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:28.463663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:28.464117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:28.464925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:28.465365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:28.610395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:28.619056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2a95905a-f394-4d6c-99fc-ecfc13eadb58 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.170298 Mar 08 13:43:28.619630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1392/2480] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:28 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:29.636764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:29.637315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:29.643661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:29.644102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:29.644889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:29.645590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:29.778609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:29.787074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-03c83ceb-cffe-456a-8dca-a1392ffac510 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154242 Mar 08 13:43:29.787630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1089/2481] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:29 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:30.804046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:30.804703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:30.811040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:30.811486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:30.812254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:30.812709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:30.947567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:30.955820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d10e0d8d-ed0a-42d8-910a-9a60035ba32e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155000 Mar 08 13:43:30.956366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1393/2482] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:30 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:31.973064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:31.973670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:31.980076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:31.980976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:31.981692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:31.982122 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:32.112972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:32.120617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1f1d95a3-09da-433c-84f9-a676ca763548 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151875 Mar 08 13:43:32.121204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1090/2483] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:31 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:33.137582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:33.138198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:33.144698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:33.145089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:33.145841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:33.146270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:33.276740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:33.284551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bc54baff-1984-4118-80a7-7c858efc2bd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150787 Mar 08 13:43:33.285156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1394/2484] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:33 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:34.301693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:34.302259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:34.308482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:34.308960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:34.309740 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:34.310175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:34.444990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:34.452704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-841d92f3-8798-46fb-8518-4a18ef0d1f56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155062 Mar 08 13:43:34.453263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1091/2485] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:34 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:35.470256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:35.471546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:35.477846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:35.478288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:35.479036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:35.479467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:35.616999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:35.621336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5ed8f74a-1caf-4071-8dcf-2cdb550caecd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154897 Mar 08 13:43:35.621899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1395/2486] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:35 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:36.638768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:36.639324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:36.645695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:36.646135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:36.646877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:36.647308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:36.785966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:36.793836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d9402905-c6dd-45fa-9369-f6f0dbc49e5b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159002 Mar 08 13:43:36.794455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1092/2487] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:36 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:37.811828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:37.812425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:37.819341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:37.819791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:37.820549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:37.821018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:37.951919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:37.960098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-61d3ceca-b92d-4138-a77d-da938ef47085 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152118 Mar 08 13:43:37.960698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1396/2488] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:37 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:38.977231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:38.977875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:38.984416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:38.984893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:38.985651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:38.986086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:39.116792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:39.124463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7fb7d697-2186-45c0-b557-aab6a57d332f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151067 Mar 08 13:43:39.125142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1093/2489] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:38 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:40.142267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:40.143374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:40.149546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:40.149993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:40.150761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:40.151174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:40.285679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:40.293394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-44f3db17-e2cf-4de0-a8db-09d3fc9179de tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154904 Mar 08 13:43:40.293957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1397/2490] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:40 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:41.310348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:41.310984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:41.317596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:41.318047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:41.318873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:41.319313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:41.458027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:41.466079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7c010ac5-71b1-424b-8d82-ec15757a355f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159516 Mar 08 13:43:41.466640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1094/2491] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:41 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:43:42.483757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:42.484514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:42.491804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:42.492365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:42.493297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:42.493776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:42.651177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:42.659132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1fa04af7-324e-4b5a-be64-48a4e7273bce tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.179633 Mar 08 13:43:42.659863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1398/2492] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:43.676394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:43.677043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:43.683501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:43.683944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:43.684727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:43.685163 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:43.813205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:43.821155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5d67cc6c-84ce-4fed-8ac3-d01d0c086e9f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.148728 Mar 08 13:43:43.821714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1095/2493] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:43 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:44.839184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:44.839776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:44.845752 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:44.846202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:44.847139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:44.847575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:44.976786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:44.984766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-26a9e845-e514-477f-8866-67f38ace22ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149384 Mar 08 13:43:44.985331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1399/2494] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:44 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:46.002366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:46.002972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:46.010152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:46.010598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:46.011354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:46.011783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:46.412679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:46.420447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1a1c96e5-fee2-4bfb-88c1-aeccc76d6883 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.421918 Mar 08 13:43:46.421063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1096/2495] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:45 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:47.437886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:47.438489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:47.444864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:47.445313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:47.446063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:47.446491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:47.580065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:47.588840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8001e5a1-3196-4a96-a0d9-41d8bdbe2292 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154639 Mar 08 13:43:47.589269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1400/2496] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:47 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:48.606363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:48.606883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:48.614041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:48.614482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:48.615236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:48.615671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:48.747066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:48.754895 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf58476a-859a-43fc-81d2-dabb3228d33d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152407 Mar 08 13:43:48.760445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1097/2497] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:48 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:49.771323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:49.771951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:49.778153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:49.778609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:49.779369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:49.779807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:49.917343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:49.924972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3cf3f754-c77a-4ca7-9c01-3183b7357a8d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157585 Mar 08 13:43:49.926088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1401/2498] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:49 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:50.942992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:50.943597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:50.949891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:50.950336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:50.951095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:50.951531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:51.081946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:51.089775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-067af66b-2766-403d-bb43-4715c73df1bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151223 Mar 08 13:43:51.090330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1098/2499] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:50 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:52.107279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:52.107856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:52.118924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:52.119380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:52.120158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:52.120595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:52.249857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:52.257747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-01e6d19f-de42-4f6c-8645-519fe2de6242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154462 Mar 08 13:43:52.258357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1402/2500] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:52 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:53.274374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:53.274979 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:53.281223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:53.281665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:53.282413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:53.282844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:53.420044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:53.428725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-237d2b46-4780-43a6-828d-e99f08335561 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158145 Mar 08 13:43:53.431265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1099/2501] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:53 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:54.445683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:54.446332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:54.452589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:54.453085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:54.453847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:54.454335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:54.587508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:54.595459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-09ed0e7b-e6b3-45af-9244-92fefc169183 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154224 Mar 08 13:43:54.596017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1403/2502] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:54 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:55.491361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:43:55.492133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:43:55.613256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:55.613860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:55.620035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:55.620475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:55.621262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:55.621691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:55.751427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:55.759099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8db42378-adf3-44fe-a86b-9fbca00bf41b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149738 Mar 08 13:43:55.759663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1100/2503] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:55 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:43:56.776021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:56.776562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:56.782778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:56.783223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:56.783972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:56.784404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:56.915466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:56.923155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bd062c81-2c5a-40d5-98ac-4ec3c992934b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151109 Mar 08 13:43:56.923715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1404/2504] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:56 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:57.940308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:57.941603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:57.947879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:57.948353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:57.949138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:57.949576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:58.098255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:58.106410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d9943e67-5dca-4fd7-be71-355ad97c2063 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.169967 Mar 08 13:43:58.107043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1101/2505] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:57 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:43:59.123234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:43:59.123956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:43:59.130588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:59.131140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:59.132045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:43:59.132347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:43:59.277009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:43:59.285622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be5ecc93-9999-48e8-9656-8f562c09e4fe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.165483 Mar 08 13:43:59.286173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1405/2506] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:43:59 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:00.302968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:00.303582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:00.309836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:00.310285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:00.311044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:00.311478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:00.441654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:00.449469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1b26ca3f-2c0d-4f83-8bb8-8f3560af560a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150997 Mar 08 13:44:00.450030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1102/2507] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:00 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:01.466359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:01.466965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:01.474068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:01.474519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:01.475270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:01.475702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:01.604731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:01.613777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2eb6e550-f788-47f9-936e-2e232f15546c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150173 Mar 08 13:44:01.614346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1406/2508] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:01 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:02.631094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:02.632576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:02.638571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:02.639015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:02.639768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:02.640201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:02.711927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:44:02.712498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:44:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:44:02.778208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:02.781923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3ad752c7-425f-4b9b-b1ad-49bf65e55342 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155101 Mar 08 13:44:02.782489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1103/2509] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:02 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:03.799680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:03.800575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:03.806815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:03.807258 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:03.808009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:03.808450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:03.940091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:03.948374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ab5a5ead-c997-4df3-b5b0-e8699c87ead8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152625 Mar 08 13:44:03.948964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1407/2510] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:03 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:04.966300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:04.966915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:04.973870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:04.974318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:04.975074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:04.975509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:05.106486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:05.114531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a49f7d10-0eb0-4b47-8e67-363835be9a4d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152028 Mar 08 13:44:05.115041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1104/2511] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:04 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:06.132329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:06.133036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:06.147866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:06.148321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:06.149147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:06.149591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:06.281020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:06.288710 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d8f133d3-3223-4dfc-adda-fa791a595861 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.161035 Mar 08 13:44:06.289276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1408/2512] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:06 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:06.778450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:44:06.778977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:44:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:44:07.306044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:07.306580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:07.312878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:07.313328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:07.314097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:07.314641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:07.527480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:07.536526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a7fb8f95-ba34-40b8-b3e0-cc1ec5d8dad8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.234379 Mar 08 13:44:07.537125 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1105/2513] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:07 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:08.553816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:08.554425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:08.561253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:08.561705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:08.562470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:08.562905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:08.697743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:08.705537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f2bebee5-c802-4acd-9677-35932c96a4b1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156129 Mar 08 13:44:08.706123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1409/2514] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:08 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:09.722555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:09.723285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:09.729554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:09.729999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:09.730764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:09.731196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:09.860825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:09.868560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9785d1eb-43a5-4e33-9eca-fca8e1ca6373 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150373 Mar 08 13:44:09.869138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1106/2515] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:09 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:10.886186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:10.886734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:10.892984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:10.893445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:10.894208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:10.894649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:11.026268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:11.033871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f50a5f8e-a84e-45c5-a821-a50a64d13c25 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151639 Mar 08 13:44:11.035032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1410/2516] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:10 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:12.008140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:44:12.008644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:44:12.051301 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:12.051898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:12.058360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:12.058811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:12.059574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:12.060012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:12.194053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:12.201821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f6302b49-1298-43a1-ac2a-1a900c22694f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154455 Mar 08 13:44:12.207345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1107/2517] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:12 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:13.222459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:13.223039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:13.229268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:13.229714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:13.230464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:13.230893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:13.362950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:13.371065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42ae7bd7-669f-42a2-80de-a219c4a7d04d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152558 Mar 08 13:44:13.371634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1411/2518] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:13 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:14.387881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:14.388486 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:14.394789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:14.395232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:14.395982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:14.396409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:14.526431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:14.534226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fb4521be-5305-456f-9bd1-a9d2d2a09faa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150115 Mar 08 13:44:14.534777 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1108/2519] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:14 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:44:15.551873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:15.552506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:15.558335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:15.558794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:15.559552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:15.560021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:15.692147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:15.699815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fddf017b-ad50-4b72-abe4-20772d22f497 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152625 Mar 08 13:44:15.700371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1412/2520] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:15 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:16.717010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:16.717658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:16.724456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:16.724943 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:16.725706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:16.726145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:16.856783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:16.864913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b57b53d-9527-4b06-9738-a67f740e8adb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151725 Mar 08 13:44:16.865475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1109/2521] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:16 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:17.882509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:17.883123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:17.889484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:17.889939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:17.890698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:17.891139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:18.022823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:18.030616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a1240126-0e5f-4d14-a9b6-846a5f40eded tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152431 Mar 08 13:44:18.031184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1413/2522] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:17 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:19.047160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:19.047779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:19.054045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:19.054522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:19.055280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:19.055730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:19.202302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:19.202302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3e7babe6-86f9-4e9a-8284-61702a7eeda2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157496 Mar 08 13:44:19.202302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1110/2523] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:19 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:20.218141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:20.218751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:20.225578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:20.226029 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:20.226816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:20.227255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:20.356012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:20.364104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0922f82e-a268-4dac-9b58-83b31ec348bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149777 Mar 08 13:44:20.364677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1414/2524] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:20 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:21.380921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:21.381528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:21.387960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:21.388407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:21.389196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:21.389626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:21.523529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:21.531201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b3a8645-3133-453e-ba6d-fcf3e3928b56 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154201 Mar 08 13:44:21.531750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1111/2525] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:21 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:22.551474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:22.552087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:22.558401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:22.558854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:22.559621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:22.560075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:22.694155 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:22.701784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-14a65085-17fa-4fae-a1f6-b01085d8de67 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154980 Mar 08 13:44:22.702352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1415/2526] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:22 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:23.719140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:23.719719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:23.725986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:23.726432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:23.727185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:23.727616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:23.875611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:23.884008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-12d5ac0d-3000-417d-b298-7d6289a30115 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.168698 Mar 08 13:44:23.885249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1112/2527] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:23 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:24.900893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:24.901417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:24.907627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:24.908064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:24.909447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:24.909933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:25.042463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:25.051651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ac84e544-32d4-4ac9-8166-342507d771a8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154671 Mar 08 13:44:25.052207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1416/2528] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:24 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:26.069511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:26.070113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:26.076632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:26.077105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:26.077864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:26.078315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:26.209627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:26.217476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-06960058-58ba-4e1b-9a85-6aeb72ccedcd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152877 Mar 08 13:44:26.218046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1113/2529] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:26 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:27.235585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:27.236181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:27.242930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:27.243369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:27.244119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:27.244549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:27.380063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:27.392109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dd9b418c-8885-467d-8369-c7ad697f2fc2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.160652 Mar 08 13:44:27.392738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1417/2530] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:27 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:28.410269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:28.410929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:28.417268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:28.417704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:28.418479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:28.418915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:28.571060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:28.578851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d5e0cf76-b6dc-472f-8cd5-00ac90d15440 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.173440 Mar 08 13:44:28.582426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1114/2531] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:28 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:29.597463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:29.598309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:29.604584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:29.605007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:29.605763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:29.606193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:29.735104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:29.742797 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-569c284c-6959-4a0f-90e0-fe0530f7e899 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150096 Mar 08 13:44:29.743352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1418/2532] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:29 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:30.759589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:30.760340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:30.766658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:30.767106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:30.767864 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:30.768491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:30.897645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:30.905405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9b14d8e8-0dff-4e18-930e-715a3cb9a708 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149663 Mar 08 13:44:30.905960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1115/2533] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:30 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:31.922236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:31.922798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:31.929100 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:31.929545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:31.930294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:31.930724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:32.061393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:32.069628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77e2db01-b5fb-4e91-9e59-1510d9cad5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151304 Mar 08 13:44:32.070195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1419/2534] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:31 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:33.086957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:33.087586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:33.093612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:33.094061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:33.094853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:33.095288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:33.226540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:33.234542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-792e2879-fe4b-46bd-92b0-fb60da5df43a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151633 Mar 08 13:44:33.235095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1116/2535] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:33 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:34.251755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:34.252948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:34.259157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:34.259602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:34.260359 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:34.260831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:34.390879 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:34.399689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f7fb10fd-1aa2-47f2-ab4a-b4733e2d7c6b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151735 Mar 08 13:44:34.400254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1420/2536] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:34 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:35.419330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:35.419939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:35.427849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:35.428464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:35.429266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:35.429992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:35.610749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:35.619360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-993060c7-5613-4913-b10d-297ab10d383d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.203809 Mar 08 13:44:35.619965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1117/2537] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:35 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:36.118373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-5b8df887-44b3-4659-aa31-296eb326a18d req-971478f3-946f-42c8-9a8c-a7f592f2c601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "701ec119-507b-4b00-b365-bb76f36feab1", "name": "network-vif-deleted", "tag": "96401a0d-79b1-4f30-8dd7-46c5c4b2731f"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:44:36.127046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-5b8df887-44b3-4659-aa31-296eb326a18d req-971478f3-946f-42c8-9a8c-a7f592f2c601 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:36.130958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-5b8df887-44b3-4659-aa31-296eb326a18d req-971478f3-946f-42c8-9a8c-a7f592f2c601 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:36.139132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-5b8df887-44b3-4659-aa31-296eb326a18d req-971478f3-946f-42c8-9a8c-a7f592f2c601 service nova] Creating event network-vif-deleted:96401a0d-79b1-4f30-8dd7-46c5c4b2731f for instance 701ec119-507b-4b00-b365-bb76f36feab1 on hv-cinder-83009 Mar 08 13:44:36.145672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-5b8df887-44b3-4659-aa31-296eb326a18d req-971478f3-946f-42c8-9a8c-a7f592f2c601 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031081 Mar 08 13:44:36.146268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1421/2538] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:44:36.636548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:36.637128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:36.644383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:36.644855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:36.645607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:36.646118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:36.786425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:36.794126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a2973ea9-b8af-4b17-876e-f6468d7921b9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.161520 Mar 08 13:44:36.794670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1118/2539] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:36 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:37.812091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:37.812816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:37.819667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:37.820120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:37.820913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:37.821350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:38.122402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:38.130082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6d3dc5f5-298e-48b2-bd1f-7c1ec0459728 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.322645 Mar 08 13:44:38.130655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1422/2540] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:37 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:39.147170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:39.147788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:39.153982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:39.154423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:39.155169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:39.155595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:39.284451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:39.292120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c8485a4d-5288-4ca7-bd01-0dc547226242 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.148984 Mar 08 13:44:39.292683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1119/2541] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:39 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:40.308819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:40.309418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:40.316557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:40.317036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:40.317814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:40.318254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:40.453332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:40.461738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b2c6606e-4837-4dc7-bce8-c84c30db016c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156845 Mar 08 13:44:40.462294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1423/2542] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:40 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:41.479230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:41.479834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:41.486439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:41.486965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:41.487717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:41.488156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:41.620172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:41.629393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b858b578-f446-4e58-ab11-9235003f2169 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154016 Mar 08 13:44:41.629954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1120/2543] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:41 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:42.646605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:42.647146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:42.653447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:42.653900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:42.654691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:42.655126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:42.786464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:42.794270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cff2ecca-422e-4e1f-a83a-a94b6c87d344 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152273 Mar 08 13:44:42.794895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1424/2544] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:43.811581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:43.812183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:43.818758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:43.819198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:43.819947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:43.820377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:43.951609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:43.959783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-351ba58f-9ef0-482c-aec5-d4328ffabdab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152102 Mar 08 13:44:43.960337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1121/2545] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:43 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:44.977327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:44.977927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:44.984121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:44.984565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:44.985348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:44.985779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:45.118309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:45.125958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d3295ca7-9f36-4330-abe3-c3699d049f86 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152477 Mar 08 13:44:45.126518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1425/2546] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:44 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:46.144069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:46.144776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:46.151045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:46.151494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:46.152246 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:46.152697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:46.283899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:46.291671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0caa5a0e-4462-4ed5-8533-d6d9e3c641e1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151951 Mar 08 13:44:46.292221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1122/2547] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:46 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:47.309323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:47.309935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:47.316848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:47.317301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:47.318061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:47.318498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:47.447667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:47.455881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-91c31063-7427-4686-8843-0eded2ffb8eb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150401 Mar 08 13:44:47.456434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1426/2548] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:47 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:48.473180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:48.473821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:48.480100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:48.480553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:48.481347 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:48.481788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:48.613348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:48.621066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f7a8ce8e-5941-4754-9bec-17ff9d41409c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152176 Mar 08 13:44:48.621640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1123/2549] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:48 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:49.638287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:49.638897 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:49.645403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:49.645851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:49.646605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:49.647040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:49.778007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:49.786671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee633913-3a4b-4edf-8eb3-01b25941096b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152257 Mar 08 13:44:49.787261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1427/2550] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:49 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:44:50.803872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:50.804510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:50.810836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:50.811288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:50.812045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:50.812482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:50.941504 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:50.949249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dcd380cf-5261-44c6-8e0c-42280147936f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149179 Mar 08 13:44:50.949806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1124/2551] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:50 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:44:51.967216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:51.967833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:51.974886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:51.975331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:51.976089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:51.976507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:52.113407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:52.122173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-43497560-cb84-4317-bc63-7c242ee6a6cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158318 Mar 08 13:44:52.123261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1428/2552] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:51 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:53.139770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:53.140365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:53.150779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:53.151218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:53.151974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:53.152402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:53.285945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:53.293687 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-83abe304-37ec-4205-a758-618d5129ce5d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157880 Mar 08 13:44:53.294279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1125/2553] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:53 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:44:54.311244 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:54.311851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:54.318443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:54.318890 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:54.319655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:54.320099 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:54.456994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:54.467253 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-59a2903d-1f44-485b-91d3-5ff80ead2dcf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159847 Mar 08 13:44:54.467829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1429/2554] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:54 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:55.485102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:55.485711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:55.491968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:55.492420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:55.493217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:55.493657 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:55.622965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:55.631198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9c1f7bf9-9fb2-46a0-a183-3087c7cdc59b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150328 Mar 08 13:44:55.631886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1126/2555] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:55 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:56.648384 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:56.648948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:56.655183 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:56.655626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:56.656375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:56.656849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:56.791461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:56.799662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7fbb3ec3-8831-407a-b306-e9f3cbe90ef6 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155303 Mar 08 13:44:56.800232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1430/2556] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:56 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:57.816582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:57.817207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:57.823626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:57.824084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:57.824886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:57.825323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:57.957235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:57.964930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c402811f-2c67-4228-89ef-ea94b9326c92 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152193 Mar 08 13:44:57.965489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1127/2557] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:57 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:44:58.983289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:44:58.983883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:44:58.990138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:58.990588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:58.991345 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:44:58.991778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:44:59.120794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:44:59.129191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-de9c8701-6cdb-462b-9662-1ebeb000d9cd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149992 Mar 08 13:44:59.129759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1431/2558] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:44:58 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:00.147353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:00.147955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:00.154198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:00.154639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:00.155390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:00.155821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:00.285722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:00.293382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f45e48bd-be13-41cf-98ed-14547369904c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149954 Mar 08 13:45:00.293933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1128/2559] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:00 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:01.311123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:01.311802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:01.318938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:01.319393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:01.320171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:01.320613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:01.452495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:01.461235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42ad3b40-15a9-4ac3-9d6e-3ff4022565a0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154001 Mar 08 13:45:01.461801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1432/2560] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:01 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:02.478614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:02.479250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:02.485481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:02.486851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:02.487608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:02.488041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:02.618395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:02.626003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-639640f5-403a-44d8-b439-eb29ae026dd2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151255 Mar 08 13:45:02.627271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1129/2561] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:02 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:03.644186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:03.644769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:03.651286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:03.651741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:03.652680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:03.653127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:03.781378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:03.789141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-326b5dea-bb44-469d-8750-d97564ea27f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149512 Mar 08 13:45:03.789704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1433/2562] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:03 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:04.805893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:04.806510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:04.812819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:04.813273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:04.814101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:04.814537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:04.947755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:04.962073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d9473699-c8fd-4da3-8967-d68826e40b18 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159670 Mar 08 13:45:04.963084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1130/2563] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:04 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:05.980681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:05.981302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:05.988873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:05.989332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:05.990103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:05.990545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:06.123883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:06.133664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8b6de93f-7184-423b-9b54-35d81cc4ffdc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156864 Mar 08 13:45:06.135689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1434/2564] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:05 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:07.152112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:07.152727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:07.159517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:07.159983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:07.160795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:07.161247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:07.292984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:07.301493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5cb2c202-e53f-499b-9f68-bb74256d1061 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153246 Mar 08 13:45:07.302054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1131/2565] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:07 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:45:08.317677 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:08.318290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:08.325124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:08.325579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:08.326354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:08.326788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:08.464137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:08.472569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0a6aee8b-0b7d-41f5-b51c-890ba29846cf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158833 Mar 08 13:45:08.473171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1435/2566] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:08 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:09.490686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:09.491273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:09.497774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:09.498225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:09.498992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:09.499423 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:09.635407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:09.643809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a2c62ff2-5c8f-4dd7-bd39-d9cbbd1f0194 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157081 Mar 08 13:45:09.644372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1132/2567] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:09 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:10.660679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:10.661305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:10.667552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:10.667992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:10.668768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:10.669203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:10.801031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:10.808833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-546b5789-493e-49f1-9b8e-8a05b2285237 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151905 Mar 08 13:45:10.809342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1436/2568] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:10 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:11.825836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:11.826443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:11.833348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:11.833791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:11.834543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:11.834973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:11.965730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:11.973581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fceefc44-f0cc-47e3-8812-312a7baac10b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151555 Mar 08 13:45:11.974139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1133/2569] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:11 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:12.991032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:12.991652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:12.997932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:12.998403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:12.999160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:12.999590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:13.136293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:13.145165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5f3ddcdb-456c-43da-9150-ef0f984ef419 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157762 Mar 08 13:45:13.145728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1437/2570] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:12 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:14.162009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:14.162600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:14.169204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:14.169648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:14.170409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:14.170838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:14.304368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:14.312172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9cb68166-1a8c-45ee-8d04-31bda236882a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154118 Mar 08 13:45:14.312760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1134/2571] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:14 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:15.329755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:15.330351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:15.336109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:15.336555 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:15.337328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:15.337759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:15.466701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:15.474595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d380b3e8-1d9a-456d-b505-13d279c5a902 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.148825 Mar 08 13:45:15.475150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1438/2572] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:15 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:16.492479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:16.493142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:16.499371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:16.499818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:16.500571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:16.501090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:16.631240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:16.638884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-437de7cf-f587-4faf-a598-c8e46ef81ff0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150333 Mar 08 13:45:16.639437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1135/2573] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:16 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:17.655804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:17.656395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:17.663245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:17.663690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:17.664449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:17.664914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:17.794137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:17.802151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-caf18733-e621-44cd-9c76-fa21e1300c16 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150164 Mar 08 13:45:17.802715 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1439/2574] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:17 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:18.819769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:18.820373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:18.826600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:18.827043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:18.827792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:18.828221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:18.961306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:18.968977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf28f1d6-fd15-4e28-b2bb-e522f866e2f7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153055 Mar 08 13:45:18.969532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1136/2575] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:18 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:19.986884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:19.987487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:19.993747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:19.994198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:19.994955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:19.995392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:20.128173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:20.135940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ee48cff4-b0d2-48f1-992c-03cd056b502b tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153388 Mar 08 13:45:20.136506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1440/2576] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:19 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:21.152894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:21.153496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:21.160206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:21.160650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:21.161421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:21.161849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:21.291404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:21.299815 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d8b49db4-d23e-48c2-b7ee-07216851fab3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150855 Mar 08 13:45:21.300377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1137/2577] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:21 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:22.320386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:22.320958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:22.327206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:22.327649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:22.328397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:22.328866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:22.460631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:22.468311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bcf326bc-ce80-4c53-9dbb-e81e3005b611 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151824 Mar 08 13:45:22.468908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1441/2578] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:22 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:23.486113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:23.486752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:23.493032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:23.493511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:23.494271 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:23.494710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:23.625002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:23.632798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b99a8f02-9806-47bc-9de2-001245d7c1be tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150861 Mar 08 13:45:23.633359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1138/2579] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:23 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:45:24.650985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:24.651534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:24.657933 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:24.658374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:24.659126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:24.659563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:24.792614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:24.800649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-639ea0cd-0423-4d8a-9302-9a8131b81c14 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153966 Mar 08 13:45:24.801261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1442/2580] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:24 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:25.817752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:25.818344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:25.824720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:25.825170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:25.825921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:25.826383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:25.958263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:25.965885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1451c06e-44ad-45b4-8c64-b9c926044f22 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152000 Mar 08 13:45:25.966435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1139/2581] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:25 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:45:26.983566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:26.984175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:26.991387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:26.991836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:26.992599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:26.993074 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:27.133338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:27.141409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-47fd0314-e7a3-41de-a3e6-d1e2513f6b88 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.162236 Mar 08 13:45:27.142610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1443/2582] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:26 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:28.163449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:28.164054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:28.170220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:28.170669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:28.171417 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:28.171847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:28.307734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:28.316400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bbc14637-c7df-4dae-b044-569692950674 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156806 Mar 08 13:45:28.317008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1140/2583] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:28 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:29.334070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:29.334689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:29.340955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:29.341409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:29.342214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:29.342657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:29.476446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:29.484488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-45036b94-5a8c-49af-8dce-6bf2debe0398 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154343 Mar 08 13:45:29.485742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1444/2584] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:29 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:30.501434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:30.502035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:30.508312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:30.508786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:30.509539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:30.509968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:30.642160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:30.649813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-924a3b29-35fb-4f1a-bbf9-d99e1807a9c7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152286 Mar 08 13:45:30.650363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1141/2585] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:30 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:31.666850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:31.667399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:31.674523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:31.674969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:31.675733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:31.676169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:31.805278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:31.812913 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-65e9abd4-c8ff-462d-9938-302a2b336eef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149961 Mar 08 13:45:31.813506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1445/2586] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:31 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:32.829362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:32.829996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:32.836034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:32.838354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:32.838354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:32.838354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:32.967714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:32.975365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-702545c3-e8c3-4b0f-bbe7-f682754e11ec tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150157 Mar 08 13:45:32.975916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1142/2587] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:32 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:33.992468 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:33.993103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:33.999319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:33.999770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:34.000575 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:34.001128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:34.130297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:34.138118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-380e79bd-a0c5-4166-9c9e-acb3c28236bc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149488 Mar 08 13:45:34.138680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1446/2588] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:33 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:35.155322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:35.155914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:35.162290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:35.162738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:35.163489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:35.163921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:35.350426 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:35.358495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-94a6e3cf-9976-4dbf-afea-5e7aa7ad4b51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.207004 Mar 08 13:45:35.359051 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1143/2589] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:35 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:36.376137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:36.376779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:36.382999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:36.383450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:36.384210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:36.384647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:36.522326 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:36.530111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5f59dd62-65c2-47c2-9415-6f3c018fe8f0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158504 Mar 08 13:45:36.530674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1447/2590] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:36 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:37.548825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:37.549432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:37.555698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:37.556151 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:37.556936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:37.557378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:37.692302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:37.700019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9907fd1e-f2ca-4530-9f69-69753e40f5ac tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155849 Mar 08 13:45:37.700571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1144/2591] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:37 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:38.716527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:38.717166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:38.724063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:38.724505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:38.725293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:38.725724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:38.857234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:38.865149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-25d641d1-e53c-4bd9-a788-717848622ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152444 Mar 08 13:45:38.865714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1448/2592] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:38 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:39.882224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:39.882855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:39.889075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:39.889519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:39.890266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:39.890696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:40.020982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:40.028618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8c6f4010-658c-4e67-a1f9-6a8e987335db tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150249 Mar 08 13:45:40.029199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1145/2593] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:39 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:41.046361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:41.047835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:41.055506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:41.055953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:41.056732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:41.057169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:41.191868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:41.199573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-70eea19c-56b0-4dcc-9b45-6bcc9342ac3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157471 Mar 08 13:45:41.200143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1449/2594] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:41 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:42.216402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:42.217056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:42.223623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:42.224100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:42.225031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:42.225473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:42.361983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:42.369751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-537c3f46-a565-40a3-98cb-b265bdcd3366 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157182 Mar 08 13:45:42.370315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1146/2595] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:43.387122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:43.387726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:43.394757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:43.395210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:43.395962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:43.396391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:43.528437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:43.536333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9db114c5-e80c-41e5-bea2-25913bed5c23 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153030 Mar 08 13:45:43.536937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1450/2596] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:43 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:44.553498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:44.554121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:44.560332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:44.560810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:44.561565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:44.561997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:44.693205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:44.700842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b6d08581-2e56-4c60-845b-3d2cbfd656ee tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151143 Mar 08 13:45:44.701393 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1147/2597] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:44 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:45.717603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:45.718320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:45.724584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:45.725073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:45.725828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:45.726257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:45.855221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:45.863899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-53c13588-2b30-4def-81e6-dc7273acb685 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150373 Mar 08 13:45:45.864460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1451/2598] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:45 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:46.881561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:46.882170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:46.888337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:46.888819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:46.889642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:46.890078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:47.034237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:47.042044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-24c03364-e526-41f7-859b-3d0bf417edd5 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.164238 Mar 08 13:45:47.042598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1148/2599] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:46 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:48.058772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:48.059374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:48.066151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:48.066603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:48.067355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:48.067787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:48.199151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:48.206963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2fc5910f-e331-4afc-be58-84e8a090ed4e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152027 Mar 08 13:45:48.207533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1452/2600] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:48 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:49.223319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:49.223909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:49.230262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:49.230705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:49.231709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:49.232136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:49.262333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:45:49.262535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:45:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb (ip 10.222.0.52) !!! Mar 08 13:45:49.363536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:49.371283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c1ed4125-3e8f-453c-9fc7-e6d0e8b0cbed tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151918 Mar 08 13:45:49.371842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1149/2601] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:49 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:50.389758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:50.390412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:50.396748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:50.397200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:50.397953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:50.398394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:50.532987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:50.540858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-67875fb2-7fee-4db2-a649-7252fccfc0fa tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154864 Mar 08 13:45:50.541438 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1453/2602] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:50 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:51.557821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:51.558430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:51.565831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:51.566278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:51.567040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:51.567478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:51.698956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:51.707355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-149d306e-c36a-458e-aeef-7c297f1d1ffe tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153416 Mar 08 13:45:51.707909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1150/2603] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:51 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:52.724305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:52.725014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:52.732080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:52.732535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:52.733344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:52.733792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:52.875456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:52.883177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cc5e4613-24e8-42a7-8388-9b1399bd37ab tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.162691 Mar 08 13:45:52.883773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1454/2604] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:52 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:53.901564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:53.902220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:53.909385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:53.909836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:53.910636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:53.911068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:54.050991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:54.058918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a5aa790-5c09-4356-b6fc-ce50f3b94f95 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.161302 Mar 08 13:45:54.059475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1151/2605] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:53 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:55.076233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:55.076868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:55.083179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:55.083628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:55.084382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:55.084851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:55.217951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:55.225863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f2673804-fa78-4f53-b8b3-72eb3fa52312 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153473 Mar 08 13:45:55.226422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1455/2606] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:55 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:56.244029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:56.244669 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:56.250932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:56.251375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:56.252126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:56.252551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:56.535575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:56.543233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8e3e18c2-47a2-4bbe-ae69-c97804a86f91 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.303013 Mar 08 13:45:56.543792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1152/2607] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:56 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:57.560389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:57.561033 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:57.567826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:57.568278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:57.569073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:57.569510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:57.701313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:57.709852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a63eb2b5-4229-40fa-a992-8d0aa58842ef tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153332 Mar 08 13:45:57.710414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1456/2608] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:57 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:58.726810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:58.727427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:58.734790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:58.735396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:58.736159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:58.736594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:58.871340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:45:58.879913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-30f07e8e-7eae-4c2f-98ba-e0383cec7dd9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.157208 Mar 08 13:45:58.880474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1153/2609] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:58 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:45:59.896962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:45:59.897565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:45:59.903707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:59.904151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:45:59.904960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:45:59.905399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:00.036465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:00.044163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-59cb9214-e575-4a5b-bda0-0cc1ef271229 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150978 Mar 08 13:46:00.044742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1457/2610] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:45:59 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:01.061366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:01.061992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:01.068329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:01.068816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:01.069583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:01.070026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:01.200858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:01.209123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eeee20e3-caad-444a-bf14-0a4512070376 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151624 Mar 08 13:46:01.209679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1154/2611] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:01 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:02.226193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:02.226791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:02.233353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:02.233892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:02.234660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:02.235112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:02.367475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:02.375805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f9e22292-a1e2-4a81-ac1b-a2dc8c6886ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153485 Mar 08 13:46:02.376367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1458/2612] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:02 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:03.393101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:03.393718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:03.399741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:03.400191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:03.400982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:03.401439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:03.535429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:03.543246 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-68632137-544a-4fb1-a52a-4acc2da76615 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154266 Mar 08 13:46:03.543791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1155/2613] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:03 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:04.560732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:04.561336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:04.567559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:04.568031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:04.568801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:04.569235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:04.701285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:04.709541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-118871ce-e38e-4afb-b47b-b298c893eb02 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152716 Mar 08 13:46:04.710098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1459/2614] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:04 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:05.726860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:05.727466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:05.734175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:05.734623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:05.735378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:05.735809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:05.869041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:05.881366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0754f0f4-d622-4061-bac0-3a718fbb456d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158337 Mar 08 13:46:05.881917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1156/2615] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:05 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:06.899133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:06.899772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:06.906440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:06.906894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:06.907660 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:06.908102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:07.037570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:07.045279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1a974c09-1930-4c02-b541-dcc644b9c4c1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150037 Mar 08 13:46:07.045828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1460/2616] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:06 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:08.062786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:08.063400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:08.069636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:08.070083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:08.070869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:08.071299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:08.199204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:08.206929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a8cc6a5a-1f94-47fa-b2d7-ecfb4eb10d6a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.148789 Mar 08 13:46:08.207480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1157/2617] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:08 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:09.223519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:09.224188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:09.230465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:09.231173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:09.231935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:09.232368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:09.365782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:09.373377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-806ca45d-a809-4981-9841-eb0bb47dda2a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153772 Mar 08 13:46:09.373942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1461/2618] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:09 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:10.391503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:10.392121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:10.398579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:10.399029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:10.399790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:10.400229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:10.533755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:10.541429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-edaa62b4-5f7b-4cc5-b988-d84a477432fb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154240 Mar 08 13:46:10.541978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1158/2619] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:10 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:11.560746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:11.561393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:11.568521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:11.569011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:11.570251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:11.570954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:11.704344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:11.711966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5d13bb4a-00c9-4b44-adad-899ae5c182e7 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155156 Mar 08 13:46:11.712527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1462/2620] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:11 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:12.729396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:12.729998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:12.736773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:12.737216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:12.737966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:12.738395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:12.867410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:12.875833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5431c836-c318-43ff-af98-58e9e6962014 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150269 Mar 08 13:46:12.876383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1159/2621] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:12 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:13.893516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:13.894159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:13.903341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:13.904136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:13.906135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:13.906923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:14.039714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:14.047340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-27f360fc-5ed1-451b-a0c2-635064bdfbdb tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.158371 Mar 08 13:46:14.047906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1463/2622] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:13 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:15.064971 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:15.065576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:15.071782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:15.072229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:15.073009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:15.073447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:15.204757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:15.212612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0bed6506-7a69-4327-8c87-951682d4bdb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151729 Mar 08 13:46:15.213430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1160/2623] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:15 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:16.229717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:16.230346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:16.236528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:16.237011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:16.237766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:16.238202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:16.371320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:16.381151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d9a2663e-6928-4785-a27d-a100dfe41487 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155383 Mar 08 13:46:16.381712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1464/2624] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:16 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:17.399074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:17.399619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:17.406283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:17.406728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:17.407488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:17.407920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:17.538723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:17.548367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-212a5030-256a-446e-aca1-f366c23dfb8e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153178 Mar 08 13:46:17.548967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1161/2625] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:17 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:18.566174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:18.566770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:18.573056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:18.573507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:18.574262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:18.574699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:18.703979 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:18.711732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54cad30f-9da2-4db4-a993-2708da0b4705 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150005 Mar 08 13:46:18.712292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1465/2626] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:18 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:19.728246 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:19.728880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:19.735952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:19.736397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:19.737180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:19.737613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:19.866035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:19.873705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6ff8a1cf-69ce-431e-bc2a-55ad4d889a41 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.149290 Mar 08 13:46:19.874288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1162/2627] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:19 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:20.890067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:20.890674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:20.897578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:20.898021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:20.898770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:20.899199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:21.031503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:21.039268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e2c8e758-5111-4dd5-94b7-8d427ea5508f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153234 Mar 08 13:46:21.039826 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1466/2628] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:20 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:22.057174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:22.057772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:22.064880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:22.065339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:22.066118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:22.066557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:22.203801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:22.212303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a2375b52-72dc-4fdc-9ee2-07f649ca2d63 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.159066 Mar 08 13:46:22.212879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1163/2629] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:22 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:23.229859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:23.230495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:23.237697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:23.238151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:23.238927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:23.239347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:23.371188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:23.379182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d62262a6-6dad-4165-9dc1-6195a1157111 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153222 Mar 08 13:46:23.379743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1467/2630] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:23 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:24.395698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:24.396308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:24.402585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:24.403029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:24.403779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:24.404209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:24.536509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:24.544145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-94857159-1966-410c-87a3-ffb7b95ae4ff tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.152558 Mar 08 13:46:24.544701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1164/2631] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:24 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:25.561148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:25.561759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:25.568025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:25.568480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:25.569279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:25.569718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:25.702995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:25.711076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-066f9fba-540e-462f-93bc-c5c055f0b568 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153828 Mar 08 13:46:25.711643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1468/2632] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:25 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:26.728134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:26.728822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:26.735732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:26.736193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:26.736958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:26.737386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:26.870698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:26.878818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-11fd26ff-f333-4de4-a2a5-7291c0f9e28a tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.154492 Mar 08 13:46:26.879380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1165/2633] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:26 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:27.895720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:27.896347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:27.902631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:27.903077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:27.903824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:27.904256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:28.039272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:28.047114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3b5bba06-7ee3-4bc7-8a6a-54cb9ce9ca00 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155365 Mar 08 13:46:28.047673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1469/2634] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:27 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:29.065185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:29.065781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:29.072322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:29.072808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:29.073673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:29.074214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:29.219961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:29.228609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5c999896-e1ea-4800-bc6c-fe28077f6830 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.168122 Mar 08 13:46:29.229289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1166/2635] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:29 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:30.246283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:30.246915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:30.253893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:30.254334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:30.255085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:30.255519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:30.385618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:30.393590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4f442e86-6db2-4f5e-9886-919cff712f32 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151139 Mar 08 13:46:30.394158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1470/2636] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:30 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:31.410746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:31.411346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:31.417635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:31.418103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:31.418858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:31.419291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:31.549275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:31.557053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2ad106d4-94b3-4c44-a88c-b0e9b3af0885 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.150177 Mar 08 13:46:31.557602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1167/2637] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:31 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:32.574550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:32.575158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:32.582356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:32.582821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:32.583580 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:32.584015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:32.715790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:32.724251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9706beac-134f-4fa1-88f1-f8accae04a06 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.153554 Mar 08 13:46:32.724838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1471/2638] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:32 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:33.840410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:33.841044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:33.847588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:33.848033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:33.848824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:33.849258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:33.983184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:33.991102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-73f02a18-4bd3-458c-8089-5002a6fcfb94 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.252916 Mar 08 13:46:33.991651 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1168/2639] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:33 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:35.008132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:35.008761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:35.014946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:35.015393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:35.016142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:35.016576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:35.144424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:35.152066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8974cc03-d515-4f45-b623-718870b767a3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.147774 Mar 08 13:46:35.152620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1472/2640] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:35 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:35.820837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:35.821369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:35.828640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:35.829116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:35.829886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:35.830322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:35.854547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:46:36.143955 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c2a7140c-29ce-4547-8936-1d736a757033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 204 len: 0 microversion: 2.1 time: 0.326650 Mar 08 13:46:36.144478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1169/2641] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:46:35 2022] DELETE /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 13:46:36.152310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:36.152953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:36.159894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:36.160346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:36.161142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:36.161581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:36.169043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:36.169746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:36.176334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:36.176817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:36.177586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:36.178024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:36.308896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:36.311628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:36.318810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5b042867-5f30-4828-9a7b-b398eccfad76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1508 microversion: 2.1 time: 0.170299 Mar 08 13:46:36.319755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1473/2642] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:36 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:36.319901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2aa121f2-2fdb-4972-9a44-bd50f2f1bb51 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.155004 Mar 08 13:46:36.320766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1170/2643] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:36 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:37.337170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:37.337780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:37.339487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:37.340106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:37.345963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:37.346416 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:37.347201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:37.347642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:37.348360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:37.348897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:37.350102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:37.350299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:37.471311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:37.479476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3eb2d6d9-caab-4ddf-8824-25ff56ebbd1a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 200 len: 1466 microversion: 2.1 time: 0.143843 Mar 08 13:46:37.480968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1171/2644] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:37 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 1466 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:37.523745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:37.536754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-76532960-2184-4438-9c25-2c31756bb5a2 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.200797 Mar 08 13:46:37.544792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1474/2645] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:37 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:37.570544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-2e8a9d66-f84c-417c-9485-7cba6d71720f req-38c4152a-db1b-4704-a500-debfa30b6f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45689a4d-e873-4671-a91a-ef1754ba3ff4", "name": "network-vif-deleted", "tag": "d984c1fd-5ea3-4f59-b6fb-7b0e99488b7a"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:46:37.578959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-2e8a9d66-f84c-417c-9485-7cba6d71720f req-38c4152a-db1b-4704-a500-debfa30b6f36 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:37.579409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-2e8a9d66-f84c-417c-9485-7cba6d71720f req-38c4152a-db1b-4704-a500-debfa30b6f36 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:37.590269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-2e8a9d66-f84c-417c-9485-7cba6d71720f req-38c4152a-db1b-4704-a500-debfa30b6f36 service nova] Creating event network-vif-deleted:d984c1fd-5ea3-4f59-b6fb-7b0e99488b7a for instance 45689a4d-e873-4671-a91a-ef1754ba3ff4 on hv-cinder-83009 Mar 08 13:46:37.595995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-2e8a9d66-f84c-417c-9485-7cba6d71720f req-38c4152a-db1b-4704-a500-debfa30b6f36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088835 Mar 08 13:46:37.596611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1172/2646] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:46:38.500415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:38.501053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: 45689a4d-e873-4671-a91a-ef1754ba3ff4] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:38.507288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.507732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:38.508487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.509137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:38.524586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] HTTP exception thrown: Instance 45689a4d-e873-4671-a91a-ef1754ba3ff4 could not be found. Mar 08 13:46:38.525193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Returning 404 to user: Instance 45689a4d-e873-4671-a91a-ef1754ba3ff4 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:46:38.525998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-065b7a94-4331-468e-b2d9-5e7291ad1f4d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4" status: 404 len: 111 microversion: 2.1 time: 0.030344 Mar 08 13:46:38.526527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1475/2647] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:38 2022] GET /compute/v2.1/servers/45689a4d-e873-4671-a91a-ef1754ba3ff4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:46:38.536745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:38.537322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:38.543330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.543773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:38.544521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.545010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:38.551273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:38.551893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:38.558080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.558540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:38.559309 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.559756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:38.575937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:46:38.721062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:38.729343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54569555-08f3-479a-a377-912ae9ab19ad tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.181890 Mar 08 13:46:38.729914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1476/2648] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:38 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:46:38.887566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d2132dcd-9459-4f76-9f27-3de111b10420 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 204 len: 0 microversion: 2.1 time: 0.354856 Mar 08 13:46:38.888217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1173/2649] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:46:38 2022] DELETE /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 13:46:38.897371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:38.898240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:38.904094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.904596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:38.905469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:38.905904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:39.048367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:39.056055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-163ed344-e8ec-4fe3-9869-f67c5f022567 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1568 microversion: 2.1 time: 0.162592 Mar 08 13:46:39.056620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1477/2650] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:46:39.750443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:39.751149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:39.757515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:39.757967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:39.758724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:39.759155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:39.957919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:39.966000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-56fbea9f-300a-46f9-8405-fe7d4cae800f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.219993 Mar 08 13:46:39.966562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1174/2651] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:39 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:40.004218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-00aafdb1-2569-48b9-89cb-710074bd566c req-fd507cc9-483f-4fdf-bdfe-ed8418fab298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd6bc389-6db6-4800-b030-7ee0a855e6de", "name": "network-vif-deleted", "tag": "98899da2-e854-4088-a9e8-69cc2165bfd8"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:46:40.012342 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-00aafdb1-2569-48b9-89cb-710074bd566c req-fd507cc9-483f-4fdf-bdfe-ed8418fab298 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:40.012820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-00aafdb1-2569-48b9-89cb-710074bd566c req-fd507cc9-483f-4fdf-bdfe-ed8418fab298 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:40.023918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-00aafdb1-2569-48b9-89cb-710074bd566c req-fd507cc9-483f-4fdf-bdfe-ed8418fab298 service nova] Creating event network-vif-deleted:98899da2-e854-4088-a9e8-69cc2165bfd8 for instance dd6bc389-6db6-4800-b030-7ee0a855e6de on hv-cinder-83009 Mar 08 13:46:40.027391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: ERROR oslo.messaging._drivers.impl_rabbit [req-00aafdb1-2569-48b9-89cb-710074bd566c req-fd507cc9-483f-4fdf-bdfe-ed8418fab298 service nova] [caf80440-ea55-4b59-859e-297a5a7fbec6] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 13:46:40.073737 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:40.074854 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:40.080849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:40.081299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:40.082058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:40.082490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:40.142994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:40.150800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fbdf6f42-270d-4c96-8df2-4cfa643ef32b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1526 microversion: 2.1 time: 0.080942 Mar 08 13:46:40.151352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1175/2652] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1526 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:46:40.984105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:40.984809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:40.990988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:40.991434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:40.992185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:40.992616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:41.036291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [req-00aafdb1-2569-48b9-89cb-710074bd566c req-fd507cc9-483f-4fdf-bdfe-ed8418fab298 service nova] [caf80440-ea55-4b59-859e-297a5a7fbec6] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60934. Mar 08 13:46:41.039705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-00aafdb1-2569-48b9-89cb-710074bd566c req-fd507cc9-483f-4fdf-bdfe-ed8418fab298 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039268 Mar 08 13:46:41.040506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1478/2653] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:46:41.127878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:41.135714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0728fe8b-b353-4be0-8e2d-c468f414c36f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.156197 Mar 08 13:46:41.136388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1176/2654] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:40 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:46:41.169282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:41.170878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:41.176964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:41.177417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:41.178182 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:41.178621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:41.239497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:41.247175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-33118be1-5218-4b12-8daf-67056b98f61c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082219 Mar 08 13:46:41.247741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1479/2655] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:42.152261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:42.152886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: 3bb7cf51-102c-4301-941a-338b211f4ddb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:42.159828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:42.160278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:42.161072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:42.161510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:42.263207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:42.264391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:42.270678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:42.271131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:42.271894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:42.272334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:42.292223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:42.300223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-692d9ba3-daf1-4b0c-9226-2fd85d3fdfbc tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb" status: 200 len: 1561 microversion: 2.1 time: 0.151797 Mar 08 13:46:42.300803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1177/2656] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:42 2022] GET /compute/v2.1/servers/3bb7cf51-102c-4301-941a-338b211f4ddb => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:42.332995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:42.346398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-caa85367-afce-49c6-afc8-35febbad7a69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086901 Mar 08 13:46:42.355729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1480/2657] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:46:43.363834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:43.364481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:43.370821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:43.371274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:43.372039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:43.372481 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:43.432604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:43.440710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-63c4f0a3-e0bb-4d19-a673-56de79bbbbb6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080732 Mar 08 13:46:43.441257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1178/2658] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:44.457301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:44.457915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:44.464106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:44.464552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:44.465337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:44.465773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:44.527673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:44.535402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8bb74f26-c596-420a-884c-4084272ede28 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082003 Mar 08 13:46:44.535967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1481/2659] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:45.551716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:45.552332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:45.558636 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:45.559091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:45.559854 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:45.560985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:45.623120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:45.631285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5469ea15-b451-4b2f-aed6-b54ce1d1af29 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083482 Mar 08 13:46:45.631831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1179/2660] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:46.649855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:46.650488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:46.656608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:46.657090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:46.657849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:46.658285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:46.716697 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:46.724536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4634acc8-04d5-472a-b8e8-c3b142c7b50a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078539 Mar 08 13:46:46.725138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1482/2661] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:47.741584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:47.742210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:47.748714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:47.749152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:47.749944 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:47.750384 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:47.809392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:47.817692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a84cac1-1419-4656-8f44-3b740d8aed14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079957 Mar 08 13:46:47.818249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1180/2662] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:48.835065 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:48.835668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:48.842020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:48.842468 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:48.843237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:48.843668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:48.901984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:48.909664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1c555860-9bb6-4ce6-8d68-6cf5faaa0a62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078504 Mar 08 13:46:48.910225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1483/2663] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:49.926235 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:49.926834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:49.933079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:49.933528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:49.934282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:49.934713 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:49.993711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:50.001438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-14ff477c-2b3e-4b55-a09f-083ca8d10014 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079088 Mar 08 13:46:50.001986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1181/2664] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:51.018860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:51.019507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:51.025812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:51.026262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:51.027023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:51.027458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:51.086959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:51.094632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c652572e-678c-4fe9-8c48-d3e9851b44e6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079723 Mar 08 13:46:51.095223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1484/2665] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:52.112192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:52.112824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:52.119150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:52.120892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:52.120892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:52.120892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:52.178783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:52.186949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3dd09aff-4a4e-412f-badd-58d00447e674 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078612 Mar 08 13:46:52.187499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1182/2666] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:53.203632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:53.204236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:53.210488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:53.210942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:53.211705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:53.212145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:53.271217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:53.279331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9f8e3b30-c158-40dd-9714-47ab66457490 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079359 Mar 08 13:46:53.280035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1485/2667] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:54.296491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:54.297137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:54.303438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:54.303886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:54.304640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:54.305101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:54.365144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:54.374693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-487ca163-e163-41d0-a941-1babf291b8d3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082520 Mar 08 13:46:54.375274 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1183/2668] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:55.394360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:55.394983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:55.405394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:55.405846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:55.406616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:55.407056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:55.464640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:55.473005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c23176a7-271c-4f4e-adc6-44de5c277eda tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085588 Mar 08 13:46:55.473559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1486/2669] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:56.490436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:56.491043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:56.497319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:56.498521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:56.499290 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:56.499728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:56.559693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:56.568071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7fa3937e-b716-4570-bea0-a8876a08fb4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081474 Mar 08 13:46:56.568622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1184/2670] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:57.584382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:57.585050 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:57.591296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:57.591706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:57.592455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:57.592946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:57.653820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:57.661723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-65c9dd5c-7709-46b0-bee0-65d0170b2906 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081159 Mar 08 13:46:57.662287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1487/2671] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:58.678226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:58.678819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:58.685682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:58.686134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:58.686893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:58.687330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:58.748966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:58.756730 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e42680cf-efaa-43b7-9941-65904c4813f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082326 Mar 08 13:46:58.757281 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1185/2672] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:46:59.772841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:46:59.773430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:46:59.779997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:59.780436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:59.781220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:46:59.781650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:46:59.839393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:46:59.847609 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5949e6d0-c020-428c-926c-5063626e4011 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078697 Mar 08 13:46:59.848170 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1488/2673] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:46:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:00.865534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:00.866083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:00.872359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:00.872851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:00.873614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:00.874054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:00.932539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:00.940370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aa7bcfac-b9a9-4f8d-9ed3-4b25fb9a5fc4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078809 Mar 08 13:47:00.940966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1186/2674] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:01.957361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:01.957989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:01.964209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:01.964688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:01.965474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:01.965964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:02.027187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:02.035449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-91887e3b-feb3-4e25-bbf7-3977ffcaf428 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081938 Mar 08 13:47:02.036016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1489/2675] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:03.052033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:03.052641 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:03.058571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:03.059022 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:03.060439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:03.060954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:03.119635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:03.127871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0cab2551-0520-4a8f-b2c1-4071d719785d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079858 Mar 08 13:47:03.128427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1187/2676] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:04.151982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:04.153154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:04.160062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:04.160510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:04.161314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:04.161748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:04.220534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:04.228351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-039f9319-94c9-42d5-9264-a400e8df89bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.087302 Mar 08 13:47:04.228965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1490/2677] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:05.245114 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:05.245803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:05.252511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:05.252997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:05.253763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:05.254205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:05.312975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:05.320741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c8263ddf-faef-4bc8-8fa7-590738a08d6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079461 Mar 08 13:47:05.321298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1188/2678] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:06.336509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:06.337149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:06.345782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:06.345782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:06.345782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:06.345782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:06.405321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:06.412951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7f864356-602f-47b6-8098-6b304b7ccb3c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080278 Mar 08 13:47:06.413512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1491/2679] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:07.429889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:07.430495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:07.437400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:07.437856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:07.438629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:07.439077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:07.499152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:07.506945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-937468aa-528e-4e7e-a3b1-aec4039f9f94 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080949 Mar 08 13:47:07.507498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1189/2680] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:08.523809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:08.524404 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:08.531273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:08.531720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:08.532480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:08.532941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:08.747554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:08.755094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ae146342-228e-43fd-a200-f1ff52145393 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.235161 Mar 08 13:47:08.755655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1492/2681] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:09.771530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:09.772175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:09.778635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:09.779156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:09.779923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:09.780362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:09.840216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:09.847877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a1623e09-63bb-45a2-836a-ce2e2c584ee8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080302 Mar 08 13:47:09.848433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1190/2682] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:10.864143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:10.864714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:10.870994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:10.871447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:10.872920 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:10.873354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:10.930429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:10.938739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d9378d04-2156-4f9c-adb3-238666837354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078543 Mar 08 13:47:10.939292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1493/2683] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:11.955855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:11.956440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:11.962677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:11.963118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:11.963867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:11.964299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:12.024494 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:12.032182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a28d32cc-914d-417b-a50a-bc1d2c784228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080135 Mar 08 13:47:12.032763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1191/2684] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:13.050541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:13.051144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:13.057419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:13.057868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:13.058625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:13.059061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:13.116805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:13.125130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f34d2598-e106-4d08-b5ac-cfacc5eca900 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078450 Mar 08 13:47:13.125686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1494/2685] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:14.141817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:14.142427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:14.148771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:14.149226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:14.149997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:14.150435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:14.209884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:14.217935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7c95188a-2586-4758-99e9-e8a52a35f8cb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081052 Mar 08 13:47:14.218661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1192/2686] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:15.235548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:15.236140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:15.242110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:15.242554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:15.243303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:15.243733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:15.301327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:15.308768 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-78f73c5e-bba1-4932-8b88-e5b9ac28fc69 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.077809 Mar 08 13:47:15.309862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1495/2687] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:47:15.499669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:47:15.499857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:47:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:47:16.326673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:16.327257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:16.333553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:16.334033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:16.334785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:16.335218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:16.393848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:16.401406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-38a7d3fd-93b2-4f27-9c5f-ecbe44bd044a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079259 Mar 08 13:47:16.401957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1193/2688] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:17.418147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:17.418978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:17.425366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:17.425812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:17.426570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:17.427008 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:17.485299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:17.493066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d78edc39-d987-4f2c-94d1-e2bbd1b059ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078634 Mar 08 13:47:17.493616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1496/2689] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:47:18.509956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:18.510606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:18.517552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:18.518000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:18.518751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:18.519194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:18.577462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:18.585092 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a48f3410-6f7a-4bcf-a8a9-63f717ce5c33 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078977 Mar 08 13:47:18.585637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1194/2690] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:19.602250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:19.602980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:19.613163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:19.613620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:19.614539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:19.614972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:19.677649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:19.686114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7b092eb1-6835-4ea3-874a-7e453de7397a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.087857 Mar 08 13:47:19.686666 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1497/2691] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:20.702010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:20.702649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:20.708883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:20.709332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:20.710094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:20.710528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:20.773340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:20.781965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d14e2a23-fd88-49f1-af8d-7fa51860f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084070 Mar 08 13:47:20.782522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1195/2692] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:21.798313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:21.798895 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:21.805365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:21.805822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:21.806587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:21.807027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:21.866564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:21.874642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-092abf0e-17b6-4056-b008-1a4a96e8ce09 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080774 Mar 08 13:47:21.875201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1498/2693] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:22.720314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:47:22.720522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:47:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:47:22.891070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:22.891645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:22.897787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:22.898232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:22.898987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:22.899417 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:22.957987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:22.966083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ab35d62b-7662-412e-8b4d-7bde8b030b1f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078997 Mar 08 13:47:22.966632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1196/2694] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:23.982926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:23.983519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:23.989854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:23.990305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:23.991064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:23.991501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:24.049267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:24.056898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8d295051-2a5a-4a57-8beb-59e81dff013d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078610 Mar 08 13:47:24.057447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1499/2695] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:25.073451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:25.074048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:25.080353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:25.080835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:25.081592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:25.082028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:25.140014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:25.147606 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4bbdc61d-5a03-4f18-9b1a-c199ad135070 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078022 Mar 08 13:47:25.148149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1197/2696] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:26.164770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:26.165379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:26.172163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:26.172608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:26.173385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:26.173820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:26.232088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:26.240176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-711cb693-3677-4756-812a-fe568384740b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079236 Mar 08 13:47:26.240751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1500/2697] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:26.788222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:47:26.788797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:47:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:47:27.256834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:27.257365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:27.264154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:27.264632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:27.265415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:27.265853 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:27.328449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:27.336278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f606991e-3f26-41fe-9990-a5f7c0ba21de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083474 Mar 08 13:47:27.336846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1198/2698] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:28.353722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:28.354598 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:28.361379 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:28.361833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:28.362640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:28.363081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:28.422468 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:28.430657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c2087b59-66ae-41e5-b387-7b1266f6de00 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081027 Mar 08 13:47:28.431215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1501/2699] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:29.447923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:29.448531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:29.454932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:29.455498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:29.456363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:29.456832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:29.520904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:29.529625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1765deea-f4c5-45f5-a834-c2a87ef3df10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085681 Mar 08 13:47:29.530194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1199/2700] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:30.547760 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:30.548377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:30.554599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:30.555040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:30.555790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:30.556224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:30.615121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:30.623698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ebe7c587-c7cf-4e6b-b51e-91dfe2cfbebf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079899 Mar 08 13:47:30.624255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1502/2701] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:31.640698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:31.641312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:31.647468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:31.647918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:31.648702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:31.649144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:31.708069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:31.716531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c78a56f6-20e4-46cb-92cd-1959e57a72ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080038 Mar 08 13:47:31.717131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1200/2702] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:32.733395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:32.734006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:32.740221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:32.740682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:32.741490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:32.741931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:32.804487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:32.813131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-241f1d2f-11c0-4bec-bf3a-2dc5d18f1fe4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083848 Mar 08 13:47:32.813691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1503/2703] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:33.830419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:33.831014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:33.837096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:33.837542 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:33.838300 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:33.838738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:33.900891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:33.909411 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8cd6873d-7254-4af2-ac0f-27c996949354 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082817 Mar 08 13:47:33.909967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1201/2704] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:47:34.926167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:34.926778 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:34.933039 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:34.933576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:34.934243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:34.934671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:35.231056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:35.238804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1387eb40-a69a-4e00-b689-bcac59f7d690 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.316525 Mar 08 13:47:35.239346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1504/2705] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:36.255052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:36.255733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:36.262040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:36.262487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:36.263257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:36.263698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:36.327014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:36.334808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-95828a40-ab1a-45a6-bc6d-e6d5447aa5c0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083669 Mar 08 13:47:36.335359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1202/2706] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:37.351122 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:37.351759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:37.358923 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:37.359371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:37.360127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:37.361564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:37.420187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:37.427848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d98d2e79-4448-4c6c-8bcb-cf871cb2a916 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080717 Mar 08 13:47:37.428391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1505/2707] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:38.445012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:38.445568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:38.452702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:38.453519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:38.454175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:38.454608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:38.514925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:38.522733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-14611f2d-21a1-4d92-8cef-882e9c19e113 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081816 Mar 08 13:47:38.523297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1203/2708] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:39.539954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:39.540565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:39.547417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:39.547869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:39.548630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:39.549092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:39.608886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:39.616494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-27de15d4-92fa-4adc-96a7-64df2fad8307 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080419 Mar 08 13:47:39.617082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1506/2709] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:40.633154 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:40.633761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:40.640877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:40.641326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:40.642086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:40.642516 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:40.702901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:40.710734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6348a0be-0b38-46c6-8bb6-9d8729106279 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081439 Mar 08 13:47:40.712165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1204/2710] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:41.727789 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:41.728400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:41.735161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:41.735615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:41.736378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:41.736848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:41.794524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:41.802297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-da5b27e3-707e-4c0b-9a34-a4ea5f085a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078311 Mar 08 13:47:41.802854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1507/2711] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:42.818959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:42.819568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:42.826498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:42.826951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:42.827727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:42.828165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:42.887181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:42.895245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1165d2f3-3568-4348-8546-49b554d65796 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080126 Mar 08 13:47:42.895811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1205/2712] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:43.912303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:43.912976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:43.920035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:43.920492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:43.921291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:43.921733 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:43.981911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:43.989591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1b4d2514-aec3-4ff4-aad0-660976921d35 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081200 Mar 08 13:47:43.990152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1508/2713] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:45.006303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:45.006916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:45.013916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:45.014371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:45.015133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:45.015576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:45.073395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:45.081903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5ce85a1d-5183-44fe-91aa-1f390ee9806d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079432 Mar 08 13:47:45.082462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1206/2714] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:46.099622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:46.100218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:46.106848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:46.107297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:46.108052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:46.108483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:46.168362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:46.176005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fcc3fe19-443c-4d55-acee-da36e46e884b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080422 Mar 08 13:47:46.176560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1509/2715] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:47.193404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:47.194121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:47.200929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:47.201380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:47.202136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:47.202567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:47.265774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:47.273563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-10f7ba84-58c1-4c8e-930f-097f8293475d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084014 Mar 08 13:47:47.274116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1207/2716] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:48.290374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:48.290952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:48.297622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:48.298068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:48.298821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:48.299254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:48.358629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:48.366574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d906cbe-ef51-424a-81d4-b66e223df798 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080107 Mar 08 13:47:48.367135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1510/2717] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:47:49.383987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:49.384587 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:49.391479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:49.402242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:49.402242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:49.402242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:49.451478 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:49.459207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bbd47ca4-4795-49d7-8d26-5a8532ef9995 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079072 Mar 08 13:47:49.459754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1208/2718] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:50.476997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:50.477586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:50.484947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:50.485398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:50.486154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:50.486592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:50.545593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:50.553233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bed6038d-b125-4928-8f21-9eb6b28b943f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080158 Mar 08 13:47:50.553790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1511/2719] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:51.570013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:51.570619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:51.577465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:51.577910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:51.578667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:51.579099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:51.638617 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:51.646440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-94841735-ed33-4388-a334-00ec92011a3a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080325 Mar 08 13:47:51.646990 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1209/2720] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:52.663091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:52.663725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:52.670015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:52.670462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:52.671241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:52.671672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:52.729346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:52.737743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9700f3d0-65a9-41eb-8973-876f0f7c0b0c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078465 Mar 08 13:47:52.738301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1512/2721] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:53.754960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:53.755567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:53.762949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:53.763395 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:53.764155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:53.764591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:53.822650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:53.830893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e9233b81-5908-41bb-8629-a5417b179d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079749 Mar 08 13:47:53.831442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1210/2722] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:54.848072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:54.848700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:54.855174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:54.855625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:54.856382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:54.856852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:54.918264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:54.925908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a20af776-51e8-4ef2-a87c-9447ad1df0f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081751 Mar 08 13:47:54.926464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1513/2723] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:55.943100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:55.943717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:55.950063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:55.950505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:55.951259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:55.951689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:56.011432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:56.019149 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-965e0464-ce1f-43b2-961f-1e6e85193471 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079889 Mar 08 13:47:56.019704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1211/2724] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:57.036264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:57.036904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:57.043787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:57.044238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:57.045030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:57.045471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:57.102315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:57.110836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1497a30d-a558-4594-aefc-2a92138038fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078467 Mar 08 13:47:57.111397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1514/2725] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:58.127372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:58.127961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:58.134272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:58.134738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:58.135506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:58.136480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:58.194372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:58.202622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c97f9fa2-6956-4b8f-80c7-8c6d374258e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079172 Mar 08 13:47:58.203165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1212/2726] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:47:59.219847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:47:59.220462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:47:59.226686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:59.227140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:59.227903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:47:59.228346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:47:59.285990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:47:59.294340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-73de7fe0-1cc1-4891-9599-107f13ac724e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078358 Mar 08 13:47:59.294892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1515/2727] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:47:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:00.311063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:00.311698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:00.317965 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:00.318410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:00.319198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:00.319631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:00.384741 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:00.392974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cd4937a7-9b95-4899-b52a-9d0a8936be96 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085947 Mar 08 13:48:00.393523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1213/2728] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:01.410409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:01.411013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:01.417509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:01.417954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:01.418709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:01.419143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:01.476878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:01.484902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b4e451d0-ad16-48e0-9fb5-1444ab20cd8d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078342 Mar 08 13:48:01.485461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1516/2729] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:02.502103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:02.502699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:02.508729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:02.509175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:02.509925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:02.510354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:02.568941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:02.577141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-faa016b0-fc8d-4e76-a688-0e13e2608e14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078865 Mar 08 13:48:02.577688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1214/2730] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:03.594456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:03.595166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:03.601621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:03.602006 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:03.602757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:03.603191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:03.662494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:03.671015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a97e5c56-e744-4516-ac13-6250f8a9a6fe tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080413 Mar 08 13:48:03.671582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1517/2731] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:04.687724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:04.688350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:04.694588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:04.695031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:04.695780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:04.696209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:04.755322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:04.762913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d65cce79-a8b5-4540-ae94-0bb3ee8b8480 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079004 Mar 08 13:48:04.763460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1215/2732] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:05.780360 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:05.781071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:05.787459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:05.787903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:05.788852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:05.789127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:05.852257 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:05.860974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d776f0e4-251a-43bd-9e5b-e6b06f6c67ab tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085656 Mar 08 13:48:05.861528 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1518/2733] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:06.878265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:06.931298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:06.931298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:06.931298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:06.931298 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:06.932098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:06.947545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:06.955956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b69f8d5e-11ff-4c2a-8cd0-592272d5c819 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081578 Mar 08 13:48:06.956507 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1216/2734] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:07.972511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:07.973153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:07.979766 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:07.980241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:07.981035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:07.981474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:08.043249 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:08.050973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f3f163f3-79fd-427a-ac50-d305c7b29eeb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082283 Mar 08 13:48:08.051531 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1519/2735] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:09.067774 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:09.068403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:09.074837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:09.075279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:09.076034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:09.076470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:09.134783 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:09.142605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b3bd174d-f51a-46e9-8b31-50a7d73f80b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078695 Mar 08 13:48:09.143164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1217/2736] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:10.159161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:10.159763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:10.165976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:10.166452 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:10.167273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:10.167712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:10.224956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:10.232876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f7735373-2d97-4459-8f76-3e9684567a7a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.077582 Mar 08 13:48:10.233429 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1520/2737] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:11.248856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:11.249469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:11.255736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:11.256184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:11.256980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:11.257425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:11.317543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:11.325236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ef83d372-59c6-451f-baa1-be5a16f31a5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080356 Mar 08 13:48:11.325791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1218/2738] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:12.342262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:12.342872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:12.349336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:12.349786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:12.350548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:12.350982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:12.409622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:12.417804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be5ae543-f3a5-4fd6-84d3-d8bb62dfb612 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079943 Mar 08 13:48:12.418362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1521/2739] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:48:13.435077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:13.435685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:13.441985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:13.442435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:13.443199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:13.443696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:13.509764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:13.518474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-71e39166-590c-4d80-90ef-79b7d6e65850 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.087840 Mar 08 13:48:13.519034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1219/2740] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:14.535279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:14.535872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:14.542279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:14.542722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:14.543478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:14.543911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:14.601853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:14.610437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40a65b28-b91e-48d1-8f5c-f7b2e67cd7ba tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079022 Mar 08 13:48:14.610987 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1522/2741] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:15.628706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:15.629286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:15.635632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:15.636078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:15.636875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:15.637323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:15.696253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:15.704027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5ab3198e-1ca5-466c-a3f6-3e7a796b8b5c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079334 Mar 08 13:48:15.704577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1220/2742] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:16.720400 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:16.721037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:16.726856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:16.727305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:16.728053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:16.729265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:16.785761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:16.793884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a19da8fa-0115-40ad-b4a4-2dbb292e247c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.077476 Mar 08 13:48:16.794441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1523/2743] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:17.811026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:17.811634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:17.817952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:17.818406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:17.819169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:17.819607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:17.884294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:17.892052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-30c22789-f42a-4484-89fd-a8ccf4767632 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085444 Mar 08 13:48:17.892602 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1221/2744] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:18.909605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:18.910149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:18.916425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:18.916910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:18.917678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:18.918115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:18.980287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:18.987929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d0c6d89d-48e1-4a11-ac27-e5201025fd49 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082269 Mar 08 13:48:18.988482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1524/2745] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:20.004958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:20.005571 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:20.012448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:20.012931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:20.013696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:20.014138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:20.071501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:20.079725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aad04166-4d93-4020-82a2-32fe6314c8dc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078641 Mar 08 13:48:20.080275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1222/2746] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:21.096089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:21.096726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:21.103346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:21.103816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:21.104573 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:21.105035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:21.173965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:21.182259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-61289718-30ba-4730-8f4a-f5f34aca2033 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.089511 Mar 08 13:48:21.182816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1525/2747] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:22.198049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:22.198697 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:22.204912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:22.205356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:22.206141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:22.206572 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:22.269693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:22.277445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-90801cf7-6e42-4826-bd5e-d5469a7c7659 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083467 Mar 08 13:48:22.278027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1223/2748] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:23.294478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:23.295079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:23.301233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:23.301683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:23.302442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:23.302877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:23.362469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:23.370161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-af246926-f811-4511-a91c-a2efa516468b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080101 Mar 08 13:48:23.370718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1526/2749] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:24.386532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:24.387145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:24.393449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:24.393898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:24.394687 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:24.395124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:24.457143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:24.465906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a2450a1d-7be5-4509-80b7-7c8d20d4d4d5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083245 Mar 08 13:48:24.466470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1224/2750] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:25.483654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:25.484297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:25.490551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:25.491004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:25.491770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:25.492208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:25.550181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:25.558431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4d5298b0-d027-4d7e-83f3-7a75dace8ace tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079266 Mar 08 13:48:25.558998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1527/2751] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:26.575677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:26.576280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:26.582560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:26.583016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:26.583768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:26.584205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:26.642527 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:26.650830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fd2a2301-ec9d-42fa-9e6c-f302303964fd tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079146 Mar 08 13:48:26.651381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1225/2752] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:27.667286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:27.667860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:27.674055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:27.674501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:27.675287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:27.675719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:27.734307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:27.741955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8be233a6-8da4-4ff1-be0e-bc538e295ab8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078593 Mar 08 13:48:27.742509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1528/2753] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:28.759020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:28.759622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:28.766052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:28.766506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:28.767275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:28.767718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:28.826169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:28.833829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f5e8c04e-26c1-4468-b543-f83510383b89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078743 Mar 08 13:48:28.834388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1226/2754] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:29.850943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:29.851535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:29.858669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:29.859114 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:29.859861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:29.860292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:29.920523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:29.928240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ea66bb27-a966-4c40-aa71-d4d330db8c7f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081170 Mar 08 13:48:29.928816 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1529/2755] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:30.950205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:30.950818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:30.957137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:30.957592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:30.958361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:30.958802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:31.018190 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:31.026279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b6321e31-015c-4597-aad8-842b3d896c2f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080515 Mar 08 13:48:31.026837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1227/2756] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:32.043291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:32.043910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:32.050691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:32.051137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:32.051899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:32.052329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:32.120073 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:32.128281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9523aa46-776c-45f9-aa31-4508c6422a76 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.089169 Mar 08 13:48:32.128873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1530/2757] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:33.146037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:33.146676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:33.153252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:33.153700 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:33.154462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:33.154929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:33.216496 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:33.224353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d338fdd2-93c8-479c-9d86-443fbba46a30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082400 Mar 08 13:48:33.224933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1228/2758] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:34.242339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:34.242954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:34.249245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:34.249692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:34.250451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:34.250886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:34.311161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:34.318972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cc3b6676-86d4-42f9-bd3f-f75c25a8c21a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080492 Mar 08 13:48:34.319774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1531/2759] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:48:35.335826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:35.336419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:35.343164 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:35.343691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:35.344462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:35.344924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:35.407567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:35.415248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2fca6c45-39e2-4b70-8a73-9428cad736a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083451 Mar 08 13:48:35.415897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1229/2760] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:48:36.432751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:36.433369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:36.439803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:36.440251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:36.441044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:36.441485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:36.501425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:36.509198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ebdb6da8-c764-4321-9d6f-8d6a0632bb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080873 Mar 08 13:48:36.509801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1532/2761] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:36.751917 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:36.752501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:36.759082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:36.759642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:36.760276 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:36.760736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:36.785229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:48:36.794525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:36.794525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:36.794525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:36.794525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:36.795146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:36.795562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:36.823295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:48:37.157117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c9dd7d39-29f9-459d-aa6c-541643ef49b1 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 204 len: 0 microversion: 2.20 time: 0.408843 Mar 08 13:48:37.157712 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1230/2762] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Mar 8 13:48:36 2022] DELETE /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 13:48:37.166476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:37.167392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:37.173015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:37.173462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:37.174221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:37.174658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:37.187758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dfb4340b-2d18-435c-bd29-6eb0bebfe786 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 204 len: 0 microversion: 2.1 time: 0.404694 Mar 08 13:48:37.188339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1533/2763] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:48:36 2022] DELETE /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:48:37.198643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:37.199341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:37.205105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:37.205548 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:37.206334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:37.206765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:37.344705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:37.351269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:37.359655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b04b7bdb-2da7-425f-88fd-e34967009008 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1682 microversion: 2.1 time: 0.165457 Mar 08 13:48:37.359842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:37.360261 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1534/2764] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:37 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:37.361383 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:37.362549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-947aa982-6a63-472c-b200-e8760a636e9e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1722 microversion: 2.20 time: 0.200583 Mar 08 13:48:37.363086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1231/2765] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:48:37 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 13:48:37.526900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:37.527460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:37.533751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:37.534194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:37.534947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:37.535375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:37.611226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:37.621216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2840f820-b24d-47de-b4a4-0626f6b355e3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.099064 Mar 08 13:48:37.622164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1535/2766] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:38.377335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:38.377959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:38.382960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:38.386392 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:38.386541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.386728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.387475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.387911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.393420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.394129 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.395101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.395552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.464277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:38.471838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-60437f3f-f1c8-4628-a81c-c662686def6b tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1615 microversion: 2.1 time: 0.098248 Mar 08 13:48:38.472326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1232/2767] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:38 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:38.485616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:38.494036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:38.495639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:38.497013 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c704f2d3-7e25-4200-afe7-43203837b108 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1655 microversion: 2.20 time: 0.120093 Mar 08 13:48:38.497776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1536/2768] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:48:38 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:48:38.642150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:38.642864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:38.666119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.666119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.666119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.666119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.774585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:38.779200 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-7c611a2f-e41e-46a0-bb42-a19826d816e9 req-2642f018-515a-40b1-93fc-08bf948fdd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a7aeeb2-799d-4194-a169-f60c3c630593", "name": "network-vif-deleted", "tag": "ba1fa56a-c485-482c-928e-4a0da2c632c4"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:48:38.785728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e12076d3-c35a-45ac-8cfc-42f4951510c1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.148931 Mar 08 13:48:38.786659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1537/2769] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:48:38.798911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-7c611a2f-e41e-46a0-bb42-a19826d816e9 req-2642f018-515a-40b1-93fc-08bf948fdd9a service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.799319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-75f82324-fbdd-4582-b570-9c845527b4f9 req-4c480b4c-72a7-4436-9d84-e0bf86b2c51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a602eb3b-374a-47cd-a8e3-ffb9cd421848", "name": "network-vif-deleted", "tag": "0d12dcd6-9922-4197-9e56-929dfbd8273d"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:48:38.799791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-7c611a2f-e41e-46a0-bb42-a19826d816e9 req-2642f018-515a-40b1-93fc-08bf948fdd9a service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.816844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-7c611a2f-e41e-46a0-bb42-a19826d816e9 req-2642f018-515a-40b1-93fc-08bf948fdd9a service nova] Creating event network-vif-deleted:ba1fa56a-c485-482c-928e-4a0da2c632c4 for instance 9a7aeeb2-799d-4194-a169-f60c3c630593 on hv-cinder-83009 Mar 08 13:48:38.829974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-7c611a2f-e41e-46a0-bb42-a19826d816e9 req-2642f018-515a-40b1-93fc-08bf948fdd9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205688 Mar 08 13:48:38.831442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-75f82324-fbdd-4582-b570-9c845527b4f9 req-4c480b4c-72a7-4436-9d84-e0bf86b2c51c service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:38.832351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-75f82324-fbdd-4582-b570-9c845527b4f9 req-4c480b4c-72a7-4436-9d84-e0bf86b2c51c service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:38.838661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1233/2770] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:48:38.849131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-75f82324-fbdd-4582-b570-9c845527b4f9 req-4c480b4c-72a7-4436-9d84-e0bf86b2c51c service nova] Creating event network-vif-deleted:0d12dcd6-9922-4197-9e56-929dfbd8273d for instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 on hv-cinder-83009 Mar 08 13:48:38.856849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-75f82324-fbdd-4582-b570-9c845527b4f9 req-4c480b4c-72a7-4436-9d84-e0bf86b2c51c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068084 Mar 08 13:48:38.858060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1538/2771] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:48:39.495115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:39.495115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:39.498840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.499285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.500196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.500633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.527759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:39.529762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:39.543091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.543628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.544493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.545049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.550637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.551363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.551825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lazy-loading 'fault' on Instance uuid a602eb3b-374a-47cd-a8e3-ffb9cd421848 {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:48:39.594055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.594527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.595092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lazy-loading 'fault' on Instance uuid 9a7aeeb2-799d-4194-a169-f60c3c630593 {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:48:39.642355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:39.649346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:39.651855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:39.653540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-646035f8-3552-486a-a0df-585ccf4d8647 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 200 len: 1332 microversion: 2.1 time: 0.167231 Mar 08 13:48:39.653827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ced48ea897124de6b874e797b6d74f3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '500118b8b6da4bba959c36961a149a19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:39.654808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40e78ac7-9ed2-4738-be96-bc32b5c186a7 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 200 len: 1371 microversion: 2.20 time: 0.140167 Mar 08 13:48:39.654976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1234/2772] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:39 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 1332 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:39.655349 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1539/2773] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:48:39 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 13:48:39.805608 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:39.806949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:39.813043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.813491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.814258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:39.814692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:39.877562 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:39.885721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-335aa0ca-fd3e-44da-bf93-7177e70d2006 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085495 Mar 08 13:48:39.886267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1235/2774] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:40.671749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:40.672337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:40.672453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:40.672997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:40.678804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:40.679256 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:40.679413 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:40.679816 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:40.680038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:40.680475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:40.680605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:40.681589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:40.694467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 could not be found. Mar 08 13:48:40.694672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Instance 9a7aeeb2-799d-4194-a169-f60c3c630593 could not be found. Mar 08 13:48:40.695055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:48:40.695177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 404 to user: Instance 9a7aeeb2-799d-4194-a169-f60c3c630593 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:48:40.695906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3cfb31f8-0d31-4748-aded-cf80c23372ef tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 404 len: 111 microversion: 2.1 time: 0.028086 Mar 08 13:48:40.696090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d8c56c7e-f01a-4c25-bbf5-0185c843017e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 404 len: 111 microversion: 2.20 time: 0.027755 Mar 08 13:48:40.696505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1540/2775] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:40 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:48:40.697519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1236/2776] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:48:40 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 08 13:48:40.705144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2302317c-27d6-460d-8005-540634fdfaf4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '.version_select at 0x7f5e31ef6a60>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:40.705430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c81c3768-25b8-4bf9-995c-adf41116e816 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '.version_select at 0x7f5e31eaa280>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:40.794385 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c81c3768-25b8-4bf9-995c-adf41116e816 tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-659459832" status: 204 len: 0 microversion: 2.20 time: 0.092744 Mar 08 13:48:40.794957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1237/2777] 10.222.0.52 () {60 vars in 1258 bytes} [Tue Mar 8 13:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-659459832 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 08 13:48:40.823291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2302317c-27d6-460d-8005-540634fdfaf4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480135837" status: 202 len: 0 microversion: 2.1 time: 0.121722 Mar 08 13:48:40.823876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1541/2778] 10.222.0.52 () {58 vars in 1220 bytes} [Tue Mar 8 13:48:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480135837 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 13:48:40.902368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:40.903295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:40.910186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:40.910568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:40.911353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:40.911787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:40.979756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:40.987577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3b375316-31ce-44e5-b6db-1eb8c1e256c7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.089588 Mar 08 13:48:40.988140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1238/2779] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:41.644851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ec40bced-39b3-4279-9ed2-ca4ecacf92b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: .version_select at 0x7f5e2d2a2280>, body: {"keypair": {"name": "tempest-keypair-54972694"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:48:41.658842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ec40bced-39b3-4279-9ed2-ca4ecacf92b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:48:41.662687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ec40bced-39b3-4279-9ed2-ca4ecacf92b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:48:42.005208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:42.005802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:42.012984 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:42.013432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:42.014189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:42.014622 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:42.037371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ec40bced-39b3-4279-9ed2-ca4ecacf92b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:48:42.041765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ec40bced-39b3-4279-9ed2-ca4ecacf92b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:48:42.054706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ec40bced-39b3-4279-9ed2-ca4ecacf92b4 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.413707 Mar 08 13:48:42.055401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1542/2780] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:48:41 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:42.076012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:42.083991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4af6fa5b-7bc2-4554-a95b-0b8ef967fabb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082617 Mar 08 13:48:42.092724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1239/2781] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:48:43.108112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:43.108750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:43.114519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:43.114976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:43.115737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:43.116181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:43.177054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:43.185209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a4714e73-2093-4dd4-b9cd-ac978bd6bae1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081422 Mar 08 13:48:43.185839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1543/2782] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:44.206661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:44.207268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:44.214345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:44.214793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:44.219324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:44.219324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:44.285034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:44.298905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8a422eb2-aa37-408a-bf23-ec51f4b6f04e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.095799 Mar 08 13:48:44.299510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1240/2783] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:44.435488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1380109098", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "03edc10a-5365-4b5f-86af-57e7b3dff290"}], "security_groups": [{"name": "tempest-securitygroup--1680862339"}], "key_name": "tempest-keypair-54972694", "user_data": "}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:48:44.533447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] validate_networks() for [('03edc10a-5365-4b5f-86af-57e7b3dff290', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:48:44.967367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:48:44.967817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:48:44.968288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:48:44.968717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:48:44.969135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:48:44.978611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:44.979218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:44.980023 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:44.980460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:44.996289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:48:45.000052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Getting quotas for user 728607c7138540d69532b0b806b9ccaf and project 754e7f374dfc4e1f9067b86fdc0cb279. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:48:45.010448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:48:45.012640 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:48:45.150240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fc8f012e-fa92-4b0c-9106-5145bac6bdb8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719004 Mar 08 13:48:45.150886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1544/2784] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:48:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:48:45.160856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-54d337fa-e415-424b-a298-3cc809d00e41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:45.161455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-54d337fa-e415-424b-a298-3cc809d00e41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:45.213529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-54d337fa-e415-424b-a298-3cc809d00e41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:45.220829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-54d337fa-e415-424b-a298-3cc809d00e41 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1240 microversion: 2.1 time: 0.063679 Mar 08 13:48:45.221311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1241/2785] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:45 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:45.315305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:45.316007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:45.323915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:45.324373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:45.325180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:45.325618 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:45.391353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:45.395571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6f8a8f01-5341-4b86-a292-7644c8a0ab11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084253 Mar 08 13:48:45.396130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1545/2786] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:46.238914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:46.239530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:46.248085 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:46.248541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:46.249343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:46.249778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:46.309128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:46.317358 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-61b35cc1-a53c-42d4-95a5-7d1510782878 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1244 microversion: 2.1 time: 0.082289 Mar 08 13:48:46.318185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1242/2787] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:46 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:46.412937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:46.413561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:46.420172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:46.420621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:46.421424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:46.421867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:46.481964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:46.489801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ea435573-de95-4717-bc43-f8d01143ca68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080785 Mar 08 13:48:46.496064 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1546/2788] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:47.335404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:47.336007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:47.342297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:47.342790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:47.343552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:47.343988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:47.406063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:47.414377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a0c4c80-f318-4147-a98c-075723d4fad9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1310 microversion: 2.1 time: 0.082860 Mar 08 13:48:47.420837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1243/2789] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:47 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:47.506856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:47.507590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:47.514125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:47.514599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:47.515361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:47.515792 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:47.574579 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:47.582565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-40941b4c-344a-4f68-9089-dcab23cc9eb1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079497 Mar 08 13:48:47.587044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1547/2790] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:48.433575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:48.434331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:48.440686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:48.441216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:48.442089 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:48.442382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:48.600984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:48.601541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:48.609549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:48.610011 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:48.610864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:48.611306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:48.698732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:48.706947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7298dbb6-13e9-414f-b910-a005a8f2b436 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.110520 Mar 08 13:48:48.707532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1548/2791] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:48:48.949775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:48.956957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d3aa59e1-b1e2-4afe-b2d0-43c0193b5753 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1366 microversion: 2.1 time: 0.527174 Mar 08 13:48:48.957521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1244/2792] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:48 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:49.130871 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-dd215fd9-0815-444a-8bb9-0360d119668d req-913708ed-5048-48da-92d3-f9c886de8cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8591a5ba-cf50-4dfa-b1ee-c1508ea8177b", "tag": "a90575dc-0e0f-4042-9196-19f830b8bc1c"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:48:49.138453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-dd215fd9-0815-444a-8bb9-0360d119668d req-913708ed-5048-48da-92d3-f9c886de8cf5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:49.138911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-dd215fd9-0815-444a-8bb9-0360d119668d req-913708ed-5048-48da-92d3-f9c886de8cf5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:49.152948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-dd215fd9-0815-444a-8bb9-0360d119668d req-913708ed-5048-48da-92d3-f9c886de8cf5 service nova] Creating event network-changed:a90575dc-0e0f-4042-9196-19f830b8bc1c for instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b on hv-cinder-83009 Mar 08 13:48:49.159444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-dd215fd9-0815-444a-8bb9-0360d119668d req-913708ed-5048-48da-92d3-f9c886de8cf5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034426 Mar 08 13:48:49.160432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1549/2793] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:48:49.723406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:49.724032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:49.731286 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:49.731734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:49.732492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:49.732958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:49.798429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:49.806264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-afee3e1e-1746-4037-9884-b28816d418e4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086746 Mar 08 13:48:49.806824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1245/2794] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:49.975329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:49.975948 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:49.982447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:49.982918 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:49.983672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:49.984105 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:50.116586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:50.124288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42b2f4fa-9099-42c3-a45d-684dbb2a9433 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1366 microversion: 2.1 time: 0.153792 Mar 08 13:48:50.124881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1550/2795] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:49 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:48:50.822261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:50.822867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:50.829162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:50.829607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:50.830364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:50.830801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:50.890970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:50.898511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dbd69156-1b2e-48af-a174-0be252c46ade tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080617 Mar 08 13:48:50.899053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1246/2796] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:51.141268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:51.141878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:51.148084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:51.148534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:51.149562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:51.150091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:51.283302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:51.290957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-34e579e8-8ce4-459c-a3c7-4ea8a58a1fc8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1366 microversion: 2.1 time: 0.153537 Mar 08 13:48:51.291533 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1551/2797] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:51 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:51.919000 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:51.919829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:51.926169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:51.927949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:51.927949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:51.927949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:51.993594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:52.001332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-529c4b18-5f78-4557-9b83-1bca2c7618f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.089305 Mar 08 13:48:52.001896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1247/2798] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:52.308474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:52.309110 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:52.315402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:52.315855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:52.316622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:52.317095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:52.455162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:52.463282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0b47f40b-b07c-45dd-96e3-d6f8e1885811 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1366 microversion: 2.1 time: 0.159490 Mar 08 13:48:52.463860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1552/2799] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:52 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:53.019209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:53.019806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:53.027619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:53.028072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:53.028875 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:53.029315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:53.087958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:53.095665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-97709ab9-d16e-4581-bf4b-73430fe1455a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080469 Mar 08 13:48:53.096222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1248/2800] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:53.481160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:53.481780 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:53.488024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:53.488491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:53.489278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:53.489714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:53.621031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:53.628135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-26310f6d-4a13-4342-8314-f4f3a0ca102f tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1366 microversion: 2.1 time: 0.151838 Mar 08 13:48:53.628709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1553/2801] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:53 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:54.113123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:54.202643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:54.202643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:54.202643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:54.202643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:54.203454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:54.203454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:54.203454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ed3ba71f-7b21-4198-a251-9777efdf7bf1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.087062 Mar 08 13:48:54.203454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1249/2802] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:54.312563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-ae19f758-2e50-4bd6-96a9-cadf804e7eac req-5bbe9e55-8fd7-4fe6-bb0b-74a853f7d83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8591a5ba-cf50-4dfa-b1ee-c1508ea8177b", "name": "network-vif-plugged", "status": "completed", "tag": "a90575dc-0e0f-4042-9196-19f830b8bc1c"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:48:54.320383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-ae19f758-2e50-4bd6-96a9-cadf804e7eac req-5bbe9e55-8fd7-4fe6-bb0b-74a853f7d83c service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:54.320872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-ae19f758-2e50-4bd6-96a9-cadf804e7eac req-5bbe9e55-8fd7-4fe6-bb0b-74a853f7d83c service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:54.331682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-ae19f758-2e50-4bd6-96a9-cadf804e7eac req-5bbe9e55-8fd7-4fe6-bb0b-74a853f7d83c service nova] Creating event network-vif-plugged:a90575dc-0e0f-4042-9196-19f830b8bc1c for instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b on hv-cinder-83009 Mar 08 13:48:54.336497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-ae19f758-2e50-4bd6-96a9-cadf804e7eac req-5bbe9e55-8fd7-4fe6-bb0b-74a853f7d83c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085179 Mar 08 13:48:54.337119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1554/2803] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:48:54.645934 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:54.646474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:54.653010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:54.653464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:54.654342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:54.654786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:54.813526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:54.820771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-497d9f5d-489d-47c7-a1cf-d72f63f531cc tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1366 microversion: 2.1 time: 0.178912 Mar 08 13:48:54.821355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1250/2804] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:54 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:55.215740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:55.221289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:55.222708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:55.223160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:55.223922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:55.224358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:55.288338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:55.296916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1d78600d-5ff2-4c70-b25b-94aedf38f4d0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086080 Mar 08 13:48:55.297473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1555/2805] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:55.837869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:55.838466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:55.844896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:55.845349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:55.846107 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:55.846545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:55.987427 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:55.995552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6739f5e5-fec2-41bf-a4f9-c2abecebbf45 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1366 microversion: 2.1 time: 0.161883 Mar 08 13:48:55.996115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1251/2806] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:55 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:56.314125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:56.314741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:56.321224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:56.321686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:56.322461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:56.322907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:56.382441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:56.390484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cc2934d5-b13c-4703-8394-7c0ad465d213 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080192 Mar 08 13:48:56.391043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1556/2807] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:57.012477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:57.013183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:57.019459 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:57.019914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:57.020698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:57.021143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:57.158716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:57.166685 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f33b8d49-61fb-4bd0-8a13-cec66258a477 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1557 microversion: 2.1 time: 0.158078 Mar 08 13:48:57.167244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1252/2808] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:57 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:57.182827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4b2ff019-4c50-421a-85ea-0328efc3b6ee tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:57.183316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4b2ff019-4c50-421a-85ea-0328efc3b6ee tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:57.189093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2ff019-4c50-421a-85ea-0328efc3b6ee tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:57.189541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2ff019-4c50-421a-85ea-0328efc3b6ee tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:57.190287 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2ff019-4c50-421a-85ea-0328efc3b6ee tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:57.190721 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4b2ff019-4c50-421a-85ea-0328efc3b6ee tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:57.270234 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4b2ff019-4c50-421a-85ea-0328efc3b6ee tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091345 Mar 08 13:48:57.270822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1557/2809] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Mar 8 13:48:57 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:48:57.407671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:57.408303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:57.414105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:57.414609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:57.415470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:57.415903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:57.479075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:57.486846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5b456326-5c46-4ba5-b0c4-08ecf7277b11 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083064 Mar 08 13:48:57.487414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1253/2810] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:58.503732 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:58.504344 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:58.520486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:58.520486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:58.520486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:58.520486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:58.525797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-ae31f440-d7d5-476f-88c7-a7750de01f18 req-2b054782-e907-46b3-b423-27503f731596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8591a5ba-cf50-4dfa-b1ee-c1508ea8177b", "tag": "a90575dc-0e0f-4042-9196-19f830b8bc1c"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:48:58.534181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-ae31f440-d7d5-476f-88c7-a7750de01f18 req-2b054782-e907-46b3-b423-27503f731596 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:58.534626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-ae31f440-d7d5-476f-88c7-a7750de01f18 req-2b054782-e907-46b3-b423-27503f731596 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:58.546205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-ae31f440-d7d5-476f-88c7-a7750de01f18 req-2b054782-e907-46b3-b423-27503f731596 service nova] Creating event network-changed:a90575dc-0e0f-4042-9196-19f830b8bc1c for instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b on hv-cinder-83009 Mar 08 13:48:58.552747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-ae31f440-d7d5-476f-88c7-a7750de01f18 req-2b054782-e907-46b3-b423-27503f731596 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030518 Mar 08 13:48:58.553547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1254/2811] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:48:58.580985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:58.589589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8c1bc194-ebae-474c-a26d-bf7a108f944e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.090049 Mar 08 13:48:58.590171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1558/2812] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:48:59.607848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:48:59.608451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:48:59.614856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:59.615540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:59.616331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:48:59.616794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:48:59.684915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:48:59.692782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2e292214-79bc-4bed-977f-618efe0b7925 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.089258 Mar 08 13:48:59.693333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1255/2813] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:48:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:00.709522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:00.710126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:00.717012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:00.717469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:00.718221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:00.718653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:00.780137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:00.787800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5ee5c6f2-0686-4f8f-9e7f-8f7465750e88 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082111 Mar 08 13:49:00.788353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1559/2814] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:01.804825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:01.806171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:01.812422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:01.812906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:01.813655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:01.814086 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:01.873260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:01.880929 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7e7b08fb-e751-44e9-8ea5-a73b2acad1c5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079915 Mar 08 13:49:01.881475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1256/2815] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:02.896854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:02.897495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:02.904202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:02.904673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:02.905446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:02.905912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:02.966098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:02.973889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3e91f2ed-2be5-4402-99eb-78b38057597f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081062 Mar 08 13:49:02.974458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1560/2816] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:03.991614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:03.993328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:03.999639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:04.000082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:04.000876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:04.001309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:04.059544 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:04.067241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9384d34f-3c54-4eff-82ee-ae242da00ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079988 Mar 08 13:49:04.067789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1257/2817] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:05.083813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:05.084519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:05.091633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:05.092084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:05.092882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:05.093322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:05.151441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:05.159027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a3de7c40-b796-495c-91b2-15ff6dbc35de tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079103 Mar 08 13:49:05.159585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1561/2818] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:06.175986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:06.176624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:06.182998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:06.183446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:06.184196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:06.184628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:06.242966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:06.250549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cce42c65-87c4-433c-947f-9504105385ec tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078557 Mar 08 13:49:06.251099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1258/2819] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:07.271066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:07.271671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:07.278187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:07.278641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:07.279424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:07.279868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:07.343904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:07.352552 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7cc5ff02-d46e-42f6-a9d1-e4c7dda0df19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.088187 Mar 08 13:49:07.353206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1562/2820] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:08.369369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:08.373266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:08.376218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:08.376721 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:08.377479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:08.377885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:08.436626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:08.444645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f704f80b-0064-4f8a-abac-4b1000aff0ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079149 Mar 08 13:49:08.445234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1259/2821] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:09.460718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:09.461977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:09.468149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:09.468601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:09.469391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:09.469829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:09.528160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:09.535820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1cded37b-cf4c-43db-841f-896559684884 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079023 Mar 08 13:49:09.536373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1563/2822] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:10.553428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:10.554043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:10.560590 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:10.561232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:10.562003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:10.562437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:10.625034 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:10.632898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3e8eb88f-885c-44c7-a74a-cef8436c8749 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084096 Mar 08 13:49:10.633637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1260/2823] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:11.650193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:11.650735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:11.657019 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:11.657466 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:11.658226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:11.658659 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:11.716154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:11.723685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d674d8c2-c369-4a57-a698-591e5a6d78f5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.077572 Mar 08 13:49:11.724232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1564/2824] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:12.741048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:12.741643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:12.748539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:12.749014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:12.749769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:12.750198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:12.813210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:12.821904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-db35811e-af5a-42da-9121-bc409b86aafb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084523 Mar 08 13:49:12.822465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1261/2825] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:13.838691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:13.839292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:13.845635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:13.846084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:13.846845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:13.847280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:13.909373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:13.917567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-56232178-dd36-4ecb-a294-aecec1ff07e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082804 Mar 08 13:49:13.918133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1565/2826] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:14.934102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:14.934733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:14.940964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:14.941410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:14.942159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:14.942593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:15.004152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:15.011736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7087a335-1b15-46a3-b2f8-d3eea17e166d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081470 Mar 08 13:49:15.012287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1262/2827] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:16.029144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:16.029744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:16.035683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:16.036135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:16.036926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:16.037368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:16.102077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:16.109801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c4a70d60-cf72-4bb7-9e9e-a04a18a94fd0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084555 Mar 08 13:49:16.110368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1566/2828] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:17.125799 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:17.126409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:17.133317 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:17.133734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:17.134501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:17.134931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:17.193823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:17.202728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c9d082af-744b-448a-b7ce-720d2f8da85e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080810 Mar 08 13:49:17.203277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1263/2829] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:18.219289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:18.219901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:18.226644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:18.227361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:18.228119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:18.228556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:18.286546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:18.294539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5eeaf3be-8f91-4247-a4b0-43afce0d2c6a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079155 Mar 08 13:49:18.295094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1567/2830] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:19.311087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:19.311692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:19.318010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:19.318459 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:19.319224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:19.319664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:19.379362 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:19.388067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a3cc864a-3598-4e59-854e-8aa6ce48a8f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080807 Mar 08 13:49:19.389880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1264/2831] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:20.405305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:20.405954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:20.412289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:20.412771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:20.413749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:20.414116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:20.472394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:20.480996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b18de3f8-4a9d-4de0-811b-5e9903200b7d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079534 Mar 08 13:49:20.481556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1568/2832] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:21.498270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:21.498881 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:21.505179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:21.505631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:21.506397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:21.506835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:21.569027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:21.576967 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a95074e5-dbaa-431c-8efa-a51df4c4e88c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082596 Mar 08 13:49:21.577524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1265/2833] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:22.593823 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:22.594437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:22.600755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:22.602063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:22.602831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:22.603265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:22.662567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:22.670995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5ff325be-afaf-4d08-a601-9cd6113775da tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081045 Mar 08 13:49:22.671558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1569/2834] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:23.687788 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:23.688392 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:23.695167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:23.695573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:23.696329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:23.696791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:23.754363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:23.762580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-23aa301c-a22b-4ab0-898f-8ecfd2c22c07 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078697 Mar 08 13:49:23.763139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1266/2835] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:24.779713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:24.780317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:24.786620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:24.787076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:24.787835 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:24.788277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:24.845873 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:24.854433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-97745d42-5233-48a1-800b-9ec25c577475 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078598 Mar 08 13:49:24.854989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1570/2836] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:25.871449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:25.872037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:25.878326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:25.878773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:25.879530 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:25.879962 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:25.938940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:25.947135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6ddb71d1-f672-4874-97d7-37eee5e36e0d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080059 Mar 08 13:49:25.947693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1267/2837] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:26.964305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:26.965005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:26.971315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:26.971762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:26.972519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:26.972982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:27.034909 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:27.043199 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6e20a3d8-2a74-4d06-9494-5d18186da454 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083650 Mar 08 13:49:27.043756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1571/2838] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:28.060138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:28.060801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:28.067181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:28.067630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:28.068418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:28.068887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:28.129858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:28.138707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7cf683a5-d63a-490c-8183-8e0899361907 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083170 Mar 08 13:49:28.139263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1268/2839] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:28.150872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bd0cbc06-6a0a-436c-bf2c-6d8854d92635 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:28.151414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bd0cbc06-6a0a-436c-bf2c-6d8854d92635 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:28.157601 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0cbc06-6a0a-436c-bf2c-6d8854d92635 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:28.158047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0cbc06-6a0a-436c-bf2c-6d8854d92635 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:28.158802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0cbc06-6a0a-436c-bf2c-6d8854d92635 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:28.159338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bd0cbc06-6a0a-436c-bf2c-6d8854d92635 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:28.181150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bd0cbc06-6a0a-436c-bf2c-6d8854d92635 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b/ips" status: 200 len: 151 microversion: 2.1 time: 0.034704 Mar 08 13:49:28.181707 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1572/2840] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:49:28 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:49:29.155348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:29.155904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:29.162109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:29.162557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:29.163378 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:29.163924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:29.223629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:29.231856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eabe82e1-d208-4930-a26b-047b700f7347 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080428 Mar 08 13:49:29.232415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1269/2841] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:30.248603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:30.249236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:30.255485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:30.255940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:30.256736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:30.257740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:30.316782 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:30.325104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7fa40d69-fc97-4989-8e9f-a12101d67058 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080388 Mar 08 13:49:30.325668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1573/2842] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:31.342062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:31.342656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:31.348983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:31.349437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:31.350204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:31.350648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:31.409009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:31.417315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cccffb70-5338-424e-9469-eb7aa390f343 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079123 Mar 08 13:49:31.417860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1270/2843] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:32.433893 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:32.434507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:32.440810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:32.441272 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:32.442035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:32.442472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:32.503440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:32.511316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6289285c-c893-45b8-ab0e-db9ebbc9c729 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081449 Mar 08 13:49:32.511882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1574/2844] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:33.528064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:33.528649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:33.534559 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:33.535003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:33.535752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:33.536191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:33.597638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:33.606349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8080bef3-e624-4b4f-9d70-e0a741c3c83b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082325 Mar 08 13:49:33.606844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1271/2845] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:34.627113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:34.627678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:34.634724 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:34.635488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:34.636271 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:34.636743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:34.707290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:34.717857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-efd38785-39d7-49d8-b489-c4a1a6892d37 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.094730 Mar 08 13:49:34.718441 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1575/2846] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:35.735830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:35.736435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:35.742810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:35.743257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:35.744013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:35.744445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:35.804255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:35.812097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-56aef8fd-237d-4d94-b02e-69cb63bf42cf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080112 Mar 08 13:49:35.812670 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1272/2847] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:36.834038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:36.834678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:36.841152 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:36.841622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:36.842371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:36.842807 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:36.907644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:36.915519 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8ab5fe7b-de4c-4598-acc6-5ed0268f9563 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.090110 Mar 08 13:49:36.916184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1576/2848] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:37.931948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:37.932552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:37.938957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:37.939406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:37.940159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:37.940593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:37.998887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:38.006505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ca7a2d85-8a90-4d7e-81f0-0d6b13e31b7e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079154 Mar 08 13:49:38.007112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1273/2849] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:39.023276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:39.023841 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:39.030002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:39.030447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:39.031202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:39.031634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:39.137189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:39.145086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fa838aa6-59eb-4444-a5da-30162eb54b06 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.125740 Mar 08 13:49:39.145682 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1577/2850] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:40.161926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:40.162556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:40.169491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:40.169941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:40.170703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:40.171138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:40.229749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:40.237407 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4eadff79-be44-4e12-915c-52ae2ce14ed9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079385 Mar 08 13:49:40.237958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1274/2851] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:41.254077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:41.254692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:41.261195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:41.261639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:41.262401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:41.262836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:41.321346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:41.329052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b427eec6-ba2c-4be9-99c4-49ba1ba8320b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079011 Mar 08 13:49:41.329604 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1578/2852] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:42.346269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:42.346885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:42.353409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:42.353860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:42.354628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:42.355061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:42.414449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:42.422258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ce8cff52-1c04-41d5-be8a-4cef4afc1929 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079885 Mar 08 13:49:42.422810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1275/2853] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:43.439196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:43.439813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:43.446868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:43.447321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:43.448080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:43.448525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:43.508307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:43.516143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-09ebe1da-028a-47b4-9399-495fbe2f09e1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080861 Mar 08 13:49:43.516726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1579/2854] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:44.533112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:44.533765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:44.540243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:44.540715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:44.541567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:44.542007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:44.602064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:44.610041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cdb1613a-2336-4559-b600-120ababd548a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080827 Mar 08 13:49:44.610591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1276/2855] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:45.627571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:45.628119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:45.634020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:45.634473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:45.635231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:45.635671 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:45.697641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:45.705284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-be827662-ead1-4cc7-95f6-fccfdcb29fe5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081902 Mar 08 13:49:45.705845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1580/2856] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:46.721830 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:46.722448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:46.729660 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:46.730111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:46.730871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:46.731309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:46.794119 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:46.801964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-43f350b4-3c04-49d2-b321-3119ba0d4228 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083986 Mar 08 13:49:46.802529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1277/2857] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:47.818711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:47.819411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:47.826040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:47.826764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:47.827550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:47.828020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:47.891137 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:47.899616 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fc3dfc6b-5c67-444c-96a3-6a1b2a402905 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084834 Mar 08 13:49:47.900175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1581/2858] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:48.917460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:48.918074 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:48.924333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:48.924814 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:48.925605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:48.926046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:48.985156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:48.993508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-58e8e306-7dcd-4dbd-9a5b-79ba1447ef14 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080069 Mar 08 13:49:48.994059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1278/2859] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:50.010201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:50.010801 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:50.017014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:50.017461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:50.018221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:50.018654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:50.076794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:50.084420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-27ab71fa-d84f-4ca2-b780-d67e9e7da62b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078594 Mar 08 13:49:50.085066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1582/2860] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:51.101299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:51.101914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:51.108223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:51.108683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:51.109458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:51.109896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:51.170328 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:51.178655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7dd2c853-d516-448e-9f9a-e5588753b55b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081342 Mar 08 13:49:51.179225 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1279/2861] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:52.196277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:52.196914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:52.203201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:52.203647 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:52.204408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:52.204892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:52.266067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:52.274082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e907c459-89c0-4492-9118-61e34846aa60 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082308 Mar 08 13:49:52.274649 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1583/2862] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:53.291177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:53.291772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:53.298047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:53.298488 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:53.299240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:53.299672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:53.359603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:53.367898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-79f5de4d-342d-4550-8336-49ff322ebe34 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081072 Mar 08 13:49:53.368456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1280/2863] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:54.384667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:54.385289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:54.392061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:54.392512 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:54.393372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:54.393805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:54.457275 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:54.466024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e0e617db-73da-47b1-89bf-c0ce53739b5d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085388 Mar 08 13:49:54.466587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1584/2864] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:55.483256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:55.483871 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:55.490196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:55.491255 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:55.492026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:55.492466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:55.550899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:55.559371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dd1b9f6b-7f08-41a4-ad8d-37bcec177c47 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080004 Mar 08 13:49:55.559940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1281/2865] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:56.575553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:56.576188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:56.582436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:56.582881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:56.583633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:56.584069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:56.642663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:56.650515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-62a39fe9-4710-40ba-ad84-c99b733dd28c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078798 Mar 08 13:49:56.651066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1585/2866] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:57.668258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:57.668931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:57.675221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:57.675677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:57.676446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:57.676920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:57.738323 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:57.747124 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e4a13814-e6f7-4dfa-b99e-c91293df8b9a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082936 Mar 08 13:49:57.747683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1282/2867] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:58.764076 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:58.764741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:58.770939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:58.771611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:58.772453 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:58.772931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:58.831728 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:58.839407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-02ea3f06-286d-46fe-a7ad-ee9b1606c60d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079203 Mar 08 13:49:58.839976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1586/2868] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:49:59.856850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:49:59.857443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:49:59.863771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:59.864227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:59.865060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:49:59.865554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:49:59.927498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:49:59.935282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0d86b282-ecfc-4029-91d0-1898e38892e0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082395 Mar 08 13:49:59.935836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1283/2869] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:49:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:00.954517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:00.955089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:00.962982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:00.963549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:00.964330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:00.964806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:01.024082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:01.031810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-43390b06-f66f-4c9f-9171-5136e5197202 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082945 Mar 08 13:50:01.032368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1587/2870] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:02.049322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:02.049940 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:02.056758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:02.057204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:02.057969 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:02.058406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:02.118643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:02.126333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dfb8c215-3336-40d8-a943-35f67b7ced62 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080873 Mar 08 13:50:02.126892 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1284/2871] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:03.142454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:03.143016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:03.149858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:03.150304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:03.151057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:03.151492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:03.214312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:03.222097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-36a1f840-9e35-421a-a7aa-fc2d82906d89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083646 Mar 08 13:50:03.222669 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1588/2872] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:04.242714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:04.243309 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:04.249555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:04.250002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:04.250755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:04.251189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:04.309553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:04.317280 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ecd6cc98-c88f-4d4e-9ecf-7e0779c685e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078987 Mar 08 13:50:04.317837 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1285/2873] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:05.334864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:05.335498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:05.341771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:05.342220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:05.342978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:05.343415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:05.408487 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:05.416833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cb511202-8608-420b-b147-c0dd05e531ce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085885 Mar 08 13:50:05.417386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1589/2874] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:06.433415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:06.434057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:06.440382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:06.440809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:06.441574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:06.442011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:06.501118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:06.509227 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f7bfc5ec-a0a2-41ce-89c7-0c3d14e0dce0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079663 Mar 08 13:50:06.509796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1286/2875] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:07.526932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:07.527556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:07.533831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:07.534276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:07.535035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:07.535470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:07.599332 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:07.607292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-61023c2b-f264-4ee5-a845-73ad11ed9994 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084247 Mar 08 13:50:07.607859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1590/2876] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:08.623926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:08.624480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:08.631442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:08.632564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:08.633371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:08.633826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:08.693008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:08.701106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bf8fc8d6-8057-4738-8370-7b8cb98df324 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081089 Mar 08 13:50:08.701666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1287/2877] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:09.718220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:09.718836 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:09.725184 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:09.725910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:09.726674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:09.727118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:09.789769 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:09.798290 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5cedc911-d080-4472-85b9-4aed85df1969 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083891 Mar 08 13:50:09.798853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1591/2878] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:10.815377 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:10.815986 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:10.822926 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:10.823373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:10.824128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:10.824568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:10.884442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:10.892129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-78269bb0-2dd9-4255-9e09-cc77a26a2ec3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080604 Mar 08 13:50:10.892706 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1288/2879] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:11.909459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:11.910082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:11.917078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:11.917854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:11.918793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:11.919251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:11.983603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:11.992225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d26e4040-b8d5-4f98-b042-644cfb3f8285 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086720 Mar 08 13:50:11.992814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1592/2880] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:13.009353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:13.009937 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:13.016241 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:13.016714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:13.017475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:13.017912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:13.083120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:13.092341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-032c6273-2fe9-4a4d-888f-8736e2875c10 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.087211 Mar 08 13:50:13.092995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1289/2881] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:14.114346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:14.115464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:14.122622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:14.123062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:14.123846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:14.125321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:14.192015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:14.203240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a9d46021-f199-46fe-88fa-d04bfc334edb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.092674 Mar 08 13:50:14.204117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1593/2882] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:15.221870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:15.222696 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:15.232017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:15.232480 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:15.233297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:15.233738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:15.304812 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:15.312735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dd3e67df-781f-427b-b151-1997e0db33d7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.094693 Mar 08 13:50:15.313295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1290/2883] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:16.330255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:16.330935 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:16.337024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:16.337472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:16.338241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:16.338674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:16.398085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:16.405765 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3ee4d93a-7602-4bf1-8971-02ed9552bff1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079674 Mar 08 13:50:16.406316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1594/2884] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:17.422447 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:17.423012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:17.429906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:17.430373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:17.431113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:17.431556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:17.491349 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:17.499326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-403425a6-b581-4654-9d16-e0465ecaab6d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080767 Mar 08 13:50:17.504857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1291/2885] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:18.515994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:18.516600 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:18.522883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:18.523314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:18.524071 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:18.524505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:18.588143 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:18.596107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-95fc2397-c230-45d2-a9fe-3a41c226b15d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083947 Mar 08 13:50:18.596680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1595/2886] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:19.613711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:19.614372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:19.620906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:19.621356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:19.622112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:19.622547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:19.681335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:19.689360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b4bdf32f-1aba-467c-95be-f2ce3b086e21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079536 Mar 08 13:50:19.690146 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1292/2887] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:20.706698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:20.707306 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:20.714067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:20.714894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:20.715254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:20.715692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:20.777314 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:20.784956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b99228bf-9bd1-4b28-8ace-af46ba71d846 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082237 Mar 08 13:50:20.785516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1596/2888] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:21.802639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:21.803218 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:21.809499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:21.809950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:21.810702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:21.811134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:21.869859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:21.877552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8009f665-1e4f-46a8-bf07-ad2ee0841229 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078941 Mar 08 13:50:21.878109 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1293/2889] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:22.894456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:22.895077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:22.902010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:22.902451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:22.903218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:22.903661 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:22.966390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:22.974297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e75f341a-5d06-4202-a871-288ac05305a0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083807 Mar 08 13:50:22.974862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1597/2890] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:23.992104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:23.992775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:23.999039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:23.999487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:24.000238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:24.000681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:24.062829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:24.070460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0256924f-132b-4b67-9a42-5e21fc2f7035 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083160 Mar 08 13:50:24.071013 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1294/2891] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:25.087632 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:25.088163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:25.094455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:25.094903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:25.095665 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:25.096103 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:25.156357 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:25.164276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d62308f0-b508-424e-8cea-7dd92c0afa74 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080827 Mar 08 13:50:25.164846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1598/2892] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:26.180797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:26.181396 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:26.187664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:26.188115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:26.188905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:26.189345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:26.249610 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:26.257803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1ffd5228-a549-44d4-b54d-4312131e9e9c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080883 Mar 08 13:50:26.258366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1295/2893] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:27.275550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:27.276260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:27.282213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:27.282737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:27.283696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:27.284185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:27.344037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:27.352756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dec10410-f09b-443b-b994-d56c2043836f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082275 Mar 08 13:50:27.353319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1599/2894] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:28.251079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:28.251686 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:28.257927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:28.258372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:28.259131 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:28.259567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:28.283021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:50:28.369016 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:28.369620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:28.377124 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:28.377565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:28.378330 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:28.378770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:28.441455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:28.449983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f00b124e-dff3-42ad-8432-3c6040a984e5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084793 Mar 08 13:50:28.450546 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1600/2895] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:28.603137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1e87e10e-998a-4068-a12a-09cd290d0610 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 204 len: 0 microversion: 2.1 time: 0.355567 Mar 08 13:50:28.603642 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1296/2896] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:50:28 2022] DELETE /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:50:28.611880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:28.612484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:28.619060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:28.619506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:28.620263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:28.620727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:28.755166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:28.762395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-397b4646-d489-487b-b030-50cdf623714d tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1682 microversion: 2.1 time: 0.154423 Mar 08 13:50:28.762960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1601/2897] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:28 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:29.467757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:29.468455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:29.475325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:29.475771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:29.476548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:29.477031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:29.536601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:29.544221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-26af70aa-cc8d-42f3-969a-707f8f3d637e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080744 Mar 08 13:50:29.544794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1297/2898] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:29.780454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:29.781106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:29.787366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:29.787813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:29.788572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:29.789035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:29.918646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:29.925950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d707db2b-61ac-47a7-bdce-d4013c041e30 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1682 microversion: 2.1 time: 0.149412 Mar 08 13:50:29.926563 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1602/2899] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:29 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:30.562517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:30.562517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:30.569719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:30.570171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:30.570935 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:30.571364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:30.675451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:30.683945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5031b4fd-cd7b-40ae-b406-cf4d263a7ab3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.125920 Mar 08 13:50:30.684509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1298/2900] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:50:30.911560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-a53c6c59-5945-4e73-bdd1-176067741f60 req-c0e4a864-de0d-4a92-b692-0c0b40c0e91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8591a5ba-cf50-4dfa-b1ee-c1508ea8177b", "name": "network-vif-deleted", "tag": "a90575dc-0e0f-4042-9196-19f830b8bc1c"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:50:30.920322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-a53c6c59-5945-4e73-bdd1-176067741f60 req-c0e4a864-de0d-4a92-b692-0c0b40c0e91d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:30.921091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-a53c6c59-5945-4e73-bdd1-176067741f60 req-c0e4a864-de0d-4a92-b692-0c0b40c0e91d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:30.933377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-a53c6c59-5945-4e73-bdd1-176067741f60 req-c0e4a864-de0d-4a92-b692-0c0b40c0e91d service nova] Creating event network-vif-deleted:a90575dc-0e0f-4042-9196-19f830b8bc1c for instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b on hv-cinder-83009 Mar 08 13:50:30.938690 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-a53c6c59-5945-4e73-bdd1-176067741f60 req-c0e4a864-de0d-4a92-b692-0c0b40c0e91d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031986 Mar 08 13:50:30.939729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1603/2901] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:50:30.946848 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:30.947666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:30.954050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:30.954745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:30.955663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:30.956308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:31.028695 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '728607c7138540d69532b0b806b9ccaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754e7f374dfc4e1f9067b86fdc0cb279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:31.037116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fdac0e22-d791-44d3-925e-0a375e1800e9 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 200 len: 1614 microversion: 2.1 time: 0.097327 Mar 08 13:50:31.041534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1299/2902] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:30 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:50:31.701964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:31.703123 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:31.712560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:31.713340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:31.714195 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:31.714639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:31.784464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:31.794838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3a4306b7-e3fe-4181-96f0-b8d53587d6db tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.098297 Mar 08 13:50:31.795427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1604/2903] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:32.054461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:32.055067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:32.061361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:32.061803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:32.062550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:32.062981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:32.076012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b could not be found. Mar 08 13:50:32.076585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:50:32.077510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b493c16c-ef93-4104-90c4-ea82f14834e8 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 404 len: 111 microversion: 2.1 time: 0.027104 Mar 08 13:50:32.078029 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1300/2904] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:32 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:50:32.086997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-05d22056-87a1-4de3-8bf5-e2385778990c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '.version_select at 0x7f5e2d41d0d0>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:32.197827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-05d22056-87a1-4de3-8bf5-e2385778990c tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54972694" status: 202 len: 0 microversion: 2.1 time: 0.115369 Mar 08 13:50:32.198509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1605/2905] 10.222.0.52 () {58 vars in 1214 bytes} [Tue Mar 8 13:50:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54972694 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:50:32.811716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:32.812245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:32.818174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:32.818609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:32.819406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:32.819832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:32.903248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:32.911404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d297abd9-8634-43c2-ab14-36468df3a9c9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.103759 Mar 08 13:50:32.912335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1301/2906] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:32.960537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:32.961069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:32.967009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:32.967458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:32.968241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:32.968726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:32.982748 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b could not be found. Mar 08 13:50:32.983343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:50:32.984163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-473b22da-47bd-4b35-878c-90796829e02a tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 404 len: 111 microversion: 2.1 time: 0.028505 Mar 08 13:50:32.984714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1606/2907] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:50:32 2022] DELETE /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:50:32.992879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:32.993570 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:32.999483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:32.999933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:33.000723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:33.001162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:33.015216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b could not be found. Mar 08 13:50:33.015805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 8591a5ba-cf50-4dfa-b1ee-c1508ea8177b could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:50:33.016676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c6dfc1ab-8c45-466e-a550-190446b50024 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b" status: 404 len: 111 microversion: 2.1 time: 0.027758 Mar 08 13:50:33.017238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1302/2908] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:32 2022] GET /compute/v2.1/servers/8591a5ba-cf50-4dfa-b1ee-c1508ea8177b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:50:33.928278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:33.928902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:33.935369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:33.935822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:33.936591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:33.937056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:34.001497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:34.010620 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6da8f261-9f90-49db-a75e-9986ce4741fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086250 Mar 08 13:50:34.011176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1607/2909] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:35.027363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:35.027921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:35.034140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:35.034567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:35.035313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:35.036526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:35.139850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:35.148265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-302351b4-df64-4ed2-bea9-1c538063483e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.124855 Mar 08 13:50:35.148847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1303/2910] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:36.165205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:36.165808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:36.172107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:36.172556 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:36.173340 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:36.173775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:36.233067 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:36.241386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2d8afeab-16c1-4c67-980b-42bb960a46d8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081221 Mar 08 13:50:36.241945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1608/2911] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:37.257340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:37.258078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:37.272490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:37.272490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:37.272490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:37.272490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:37.336353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:37.344364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9073405c-96c6-4eb6-9d8f-86db847c8665 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.090883 Mar 08 13:50:37.345178 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1304/2912] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:38.361216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:38.361825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:38.368735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:38.369189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:38.369955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:38.370380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:38.432177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:38.440126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e92f8a16-8f43-4afc-8799-4d5eb78b4706 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082754 Mar 08 13:50:38.440627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1609/2913] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:39.456524 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:39.457693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:39.464100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:39.464548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:39.465332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:39.465767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:39.525285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:39.533224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-994c2707-4a8d-441d-b6ca-ac38b8b70e44 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080568 Mar 08 13:50:39.533782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1305/2914] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:40.550594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:40.551569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:40.557863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:40.558311 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:40.559086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:40.559516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:40.618104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:40.625692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ffd7c965-c64b-48a0-83d7-2a8eafb5c02b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078958 Mar 08 13:50:40.626251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1610/2915] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:41.642938 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:41.643531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:41.650346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:41.650798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:41.651556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:41.651991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:41.709835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:41.717420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3bfd9f59-22e5-41a9-afdc-fc2d818c40a5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078448 Mar 08 13:50:41.717978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1306/2916] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:42.734929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:42.735572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:42.742524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:42.742978 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:42.743742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:42.744211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:42.803656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:42.811432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b37739eb-d790-4997-b412-1408bf767aad tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080297 Mar 08 13:50:42.811992 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1611/2917] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:43.828210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:43.828856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:43.835611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:43.836060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:43.836852 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:43.837287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:43.896452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:43.904257 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a7b0d53e-7606-4195-bb9f-39e47e305fac tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079921 Mar 08 13:50:43.904835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1307/2918] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:43 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:44.921974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:44.922576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:44.928420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:44.928905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:44.929657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:44.930090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:44.989668 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:44.997239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8c4d56ab-0ff8-4add-9c61-637bdc2675e9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079257 Mar 08 13:50:44.997793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1612/2919] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:46.014443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:46.015038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:46.022181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:46.022746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:46.023499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:46.023932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:46.082193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:46.089771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cffd3153-4794-400c-b22b-6bffa7844122 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079252 Mar 08 13:50:46.090325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1308/2920] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:46.796649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:50:46.796901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:50:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:50:47.108764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:47.110343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:47.120716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:47.121174 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:47.121950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:47.122385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:47.183166 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:47.190952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4eb03f2b-f2e2-4f89-accf-5ec99ebde17d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.088382 Mar 08 13:50:47.191619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1613/2921] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:48.207688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:48.208292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:48.214649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:48.215090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:48.215840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:48.216303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:48.276189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:48.283793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea41fe6f-e8cc-4756-b4e6-45a5941cd9d1 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080021 Mar 08 13:50:48.284334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1309/2922] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:49.272275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:50:49.272978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:50:49.300403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:49.301851 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:49.307759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:49.308207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:49.309043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:49.309481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:49.374144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:49.383107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-157fd383-278c-4e16-aaa3-15dbf967cfde tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086475 Mar 08 13:50:49.383678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1614/2923] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:50.400380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:50.400976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:50.407363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:50.407812 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:50.408576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:50.409044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:50.471555 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:50.481611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f1178101-e70c-4e9b-b99e-bc69e8bddbe3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085166 Mar 08 13:50:50.482169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1310/2924] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:51.498884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:51.499481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:51.506425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:51.506869 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:51.507621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:51.508084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:51.568075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:51.575922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1d73bd13-59a6-4a00-bec1-e5d1a7283c9b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080852 Mar 08 13:50:51.576490 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1615/2925] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:52.592453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:52.593117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:52.599750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:52.600141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:52.600921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:52.601351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:52.659611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:52.667210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4be773f2-7a8b-4f64-be25-0597964656ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078593 Mar 08 13:50:52.667759 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1311/2926] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:53.683829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:53.684472 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:53.690800 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:53.691283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:53.692047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:53.692483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:53.751030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:53.758824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ba4a6802-2405-411d-a77c-d3116600f5c6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078842 Mar 08 13:50:53.759386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1616/2927] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:54.776340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:54.777180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:54.784169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:54.785259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:54.786037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:54.786464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:54.844380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:54.853046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-35825df4-dc69-4c50-837b-ee6313ce74c8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081217 Mar 08 13:50:54.853596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1312/2928] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:54 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:55.869470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:55.870066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:55.876280 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:55.876770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:55.877538 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:55.877977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:55.935911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:55.943838 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-733c4b4f-2a39-490a-a454-5265139ced05 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078222 Mar 08 13:50:55.944399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1617/2929] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:56.960841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:56.961445 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:56.967752 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:56.968221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:56.969053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:56.969436 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:57.027947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:57.036611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8ed14b4d-c72d-4ced-b2da-9f0512135140 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079934 Mar 08 13:50:57.037196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1313/2930] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:58.053207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:58.053798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:58.060056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:58.060503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:58.061307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:58.061745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:58.124905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:58.135426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ef0f264b-7e2e-48a4-9df2-31f3147e04f0 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085952 Mar 08 13:50:58.139757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1618/2931] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:50:59.155430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:50:59.155961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:50:59.162767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:59.163206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:59.164035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:50:59.164466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:50:59.222419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:50:59.232102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-39ca82d6-bf61-45e4-8e90-5988c9fd822a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080586 Mar 08 13:50:59.232677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1314/2932] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:50:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:00.249391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:00.250032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:00.256365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:00.256862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:00.257627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:00.258069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:00.315375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:00.323144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-760d5868-989f-4b43-bb91-e2efeaffa610 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.077663 Mar 08 13:51:00.323704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1619/2933] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:01.340003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:01.340584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:01.347429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:01.347879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:01.348638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:01.349747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:01.408918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:01.417216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-08f5bf06-38ca-459e-9734-9abe5bc3493b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081047 Mar 08 13:51:01.417778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1315/2934] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:02.434794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:02.435427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:02.442176 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:02.442624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:02.443393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:02.443833 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:02.509221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:02.517447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-63ac4420-5b82-4db5-be78-31e2c11600fc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086422 Mar 08 13:51:02.518233 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1620/2935] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:03.534987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:03.535613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:03.541549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:03.541989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:03.542740 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:03.543171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:03.607674 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:03.615403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0519d9b7-6d70-4bc7-9e53-cccc9060bc78 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084306 Mar 08 13:51:03.615954 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1316/2936] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:04.632087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:04.632635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:04.638867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:04.639321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:04.640080 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:04.640520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:04.698894 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:04.706584 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3b15d387-5fc4-4a39-851f-61d71506a40d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078532 Mar 08 13:51:04.707158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1621/2937] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:05.723405 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:05.724012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:05.731063 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:05.731511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:05.732265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:05.732720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:05.792549 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:05.800387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-69cae545-d11a-4840-8f22-2114caaa2c4f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080864 Mar 08 13:51:05.800958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1317/2938] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:06.817514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:06.818159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:06.824346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:06.824822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:06.825576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:06.826005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:06.884270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:06.891967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-86252a26-420e-491c-8595-03e4e68c735c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079021 Mar 08 13:51:06.892525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1622/2939] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:06 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:07.909851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:07.910540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:07.916869 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:07.917318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:07.918078 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:07.918510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:07.977020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:07.984619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-56bb9663-b1ad-4e0c-b820-75076b009363 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079244 Mar 08 13:51:07.985186 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1318/2940] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:09.001809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:09.002353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:09.008638 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:09.009141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:09.009900 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:09.010358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:09.068925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:09.076494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-25d30dc5-10e1-498a-8932-c0898af234f7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078645 Mar 08 13:51:09.077086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1623/2941] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:51:10.093444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:10.094028 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:10.100600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:10.101075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:10.101824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:10.102251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:10.166545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:10.174341 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d990a464-1e63-45ec-bf2e-d261315f72f9 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084743 Mar 08 13:51:10.175145 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1319/2942] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:11.191150 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:11.191787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:11.198046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:11.198491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:11.199254 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:11.199687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:11.257977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:11.265698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-533d7837-ae97-4480-a585-fbcdc3d00ab5 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078422 Mar 08 13:51:11.266358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1624/2943] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:12.282471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:12.283096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:12.289981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:12.290430 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:12.291193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:12.291626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:12.351203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:12.359082 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d284a5aa-c356-48cc-99a3-d31968acf046 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080509 Mar 08 13:51:12.359664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1320/2944] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:13.375210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:13.375829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:13.382627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:13.383081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:13.383847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:13.384288 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:13.444497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:13.452206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e1413a38-7ea0-48de-a091-324fcdbc0713 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080820 Mar 08 13:51:13.452787 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1625/2945] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:14.469440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:14.470050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:14.477548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:14.477993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:14.478751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:14.479216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:14.538245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:14.545992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-30911c75-859c-4b6f-be72-cc6ec9346627 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080402 Mar 08 13:51:14.546553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1321/2946] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:15.562865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:15.563482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:15.570040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:15.570492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:15.571252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:15.571686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:15.633906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:15.641585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d35c06f3-667d-4c2d-9fb0-aad8e213aa08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082712 Mar 08 13:51:15.642146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1626/2947] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:16.657637 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:16.658193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:16.664422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:16.664907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:16.665663 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:16.666096 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:16.729776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:16.737605 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bdfbd5be-60af-46cf-90be-15ba3df10d42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083295 Mar 08 13:51:16.738155 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1322/2948] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:17.754898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:17.755572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:17.761774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:17.762225 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:17.762983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:17.763422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:17.822308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:17.829963 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bce1736e-fe7c-45b9-8cc9-b358574b026c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079726 Mar 08 13:51:17.831085 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1627/2949] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:18.847153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:18.847873 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:18.854526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:18.854973 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:18.855732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:18.856167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:18.915391 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:18.923087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-28e8b9a5-afaf-4c83-8f89-1c3ab03cc7f8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079821 Mar 08 13:51:18.923666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1323/2950] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:18 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:19.940725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:19.941355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:19.947590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:19.948041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:19.948840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:19.949284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:20.008070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:20.015798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0fb4df6e-95f8-4d43-bef5-b1ce839d6e3b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079665 Mar 08 13:51:20.016363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1628/2951] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:21.032797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:21.033412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:21.039613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:21.040060 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:21.040857 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:21.041304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:21.099763 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:21.107499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e69b0ed9-46ad-4d93-99f0-a0d303bb4c30 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078588 Mar 08 13:51:21.108056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1324/2952] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:22.123843 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:22.124454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:22.131624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:22.132165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:22.132881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:22.133319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:22.192491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:22.200274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6d9359a4-e0f2-4f10-a309-c3dda8db5f1b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080305 Mar 08 13:51:22.200867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1629/2953] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:23.217132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:23.217715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:23.224903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:23.225353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:23.226104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:23.226535 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:23.284239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:23.291889 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8e4e034d-b046-4a47-a503-409d0a651c92 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078653 Mar 08 13:51:23.292438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1325/2954] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:24.308651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:24.309329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:24.315716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:24.316165 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:24.316966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:24.317408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:24.377446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:24.385172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-88e6a4a1-b178-40cb-8c6a-ca50d7b82b3e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080359 Mar 08 13:51:24.385729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1630/2955] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:25.402216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:25.402825 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:25.409206 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:25.409658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:25.410415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:25.410851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:25.469634 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:25.477727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-253ad8c1-9e2d-4e54-acca-bc2fa8edaad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079326 Mar 08 13:51:25.478282 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1326/2956] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:26.493910 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:26.494521 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:26.500903 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:26.501358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:26.502243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:26.502735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:26.560953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:26.568878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1e2ce3fa-ead0-4b68-a1fa-148dea90738f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078773 Mar 08 13:51:26.569449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1631/2957] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:27.585226 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:27.585862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:27.592113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:27.592557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:27.593351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:27.593879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:27.652567 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:27.660819 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8a3034e5-e567-4737-8c43-f3e54763b739 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079460 Mar 08 13:51:27.661376 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1327/2958] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:28.678118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:28.678735 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:28.685072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:28.685529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:28.686328 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:28.686774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:28.752089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:28.760001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54eaec24-3ce6-4052-84d5-f7601186a085 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086321 Mar 08 13:51:28.760562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1632/2959] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:51:29.777232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:29.777820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:29.783977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:29.784418 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:29.785198 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:29.785630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:29.850296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:29.857980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-58da7ad8-221f-445b-a3e5-549e884b0d5e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084570 Mar 08 13:51:29.858540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1328/2960] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:29 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:30.875059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:30.875673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:30.882539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:30.882994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:30.883763 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:30.884203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:30.942481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:30.950139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1f8a44bb-0845-4eb3-b022-a0f36a2358bb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078990 Mar 08 13:51:30.950702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1633/2961] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:31.967320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:31.967927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:31.975220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:31.975665 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:31.976433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:31.976901 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:32.042044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:32.049711 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bbbb240e-5305-496d-a8bd-54631e27cb04 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.086321 Mar 08 13:51:32.050263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1329/2962] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:33.066969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:33.067532 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:33.074106 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:33.074561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:33.075362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:33.075802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:33.134675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:33.142250 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-36909524-f058-42b2-93d3-5d582141a4b6 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079810 Mar 08 13:51:33.143398 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1634/2963] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:34.159205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:34.159908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:34.165886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:34.174296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:34.174296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:34.174296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:34.227172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:34.235199 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-258986d5-2712-47f5-b5c3-b95f33c42db3 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079815 Mar 08 13:51:34.235746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1330/2964] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:35.303335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:35.303954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:35.310063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:35.310565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:35.312376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:35.312376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:35.372505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:35.381246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cd2a535d-7562-4e90-93f6-59a64f245c3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.132498 Mar 08 13:51:35.381803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1635/2965] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:51:36.398818 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:36.399772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:36.406118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:36.406563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:36.407339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:36.408803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:36.469768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:36.478933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c4dc2487-0244-46a7-8baa-c1388751aa5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083962 Mar 08 13:51:36.479952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1331/2966] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:37.496929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:37.497559 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:37.504370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:37.504858 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:37.505636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:37.506082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:37.565365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:37.573351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6fb8183f-5d0d-4b39-8c4d-70bf7419e8be tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081213 Mar 08 13:51:37.576101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1636/2967] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:38.590390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:38.591025 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:38.597446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:38.597891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:38.598907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:38.599438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:38.661975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:38.669846 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-21b75a5a-d190-4443-a3bc-6fe1a8a63f1c tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083334 Mar 08 13:51:38.670410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1332/2968] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:39.687060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:39.687703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:39.694744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:39.695189 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:39.695941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:39.696374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:39.754498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:39.762206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e103dd62-3e02-4e63-90f0-6ad11a7f973f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079173 Mar 08 13:51:39.762772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1637/2969] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:40.779838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:40.780440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:40.786888 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:40.787329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:40.788084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:40.788522 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:40.848314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:40.856047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-18554ab9-1314-4d41-a82a-2b700c0e0c84 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080081 Mar 08 13:51:40.856596 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1333/2970] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:40 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:41.873352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:41.873984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:41.880764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:41.881207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:41.881957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:41.882388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:41.945936 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:41.953730 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-db70c658-9c71-4929-95f3-ce81bbc09165 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084234 Mar 08 13:51:41.954296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1638/2971] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:41 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:42.972017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:42.972743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:42.979372 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:42.979826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:42.980591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:42.981061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:43.043499 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:43.051248 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-acf63e85-f851-47ea-81a5-c512f5e441c4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084761 Mar 08 13:51:43.051801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1334/2972] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:42 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:44.067651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:44.068286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:44.074520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:44.074965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:44.075714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:44.076269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:44.134492 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:44.142772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dd5fa193-7bd5-488c-8e94-3a9c50f9fe8b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078242 Mar 08 13:51:44.143424 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1639/2973] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:44 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:45.159897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:45.160439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:45.166803 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:45.167258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:45.168020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:45.168454 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:45.228566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:45.237064 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-16fc4d88-5878-4999-8089-8538cc88e650 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081441 Mar 08 13:51:45.237623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1335/2974] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:45 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:46.254431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:46.255066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:46.261049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:46.261501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:46.262260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:46.262700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:46.322403 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:46.330194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d1a0dddb-3a88-4640-a0ad-3193aa763322 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080415 Mar 08 13:51:46.330754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1640/2975] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:46 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:47.346603 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:47.347209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:47.353831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:47.354277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:47.355040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:47.355470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:47.421259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:47.430616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5f628499-4229-4890-a66c-63d19b437809 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.088022 Mar 08 13:51:47.431175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1336/2976] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:47 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:48.447246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:48.447828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:48.454059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:48.454485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:48.455237 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:48.455675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:48.515203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:48.523133 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a3f28077-1b9d-4b6e-8b71-6fe66498857a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079752 Mar 08 13:51:48.523692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1641/2977] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:48 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:49.539222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:49.539834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:49.546307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:49.546757 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:49.547519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:49.547988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:49.608564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:49.616577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f9e05a7c-f107-4fc3-bdc1-0fb7c3f99d90 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081236 Mar 08 13:51:49.617167 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1337/2978] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:49 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:50.633523 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:50.634079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:50.640297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:50.640832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:50.647128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:50.647128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:50.702232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:50.712759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-09422b56-45c1-4fc3-8ae6-8037f48f5467 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083290 Mar 08 13:51:50.713331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1642/2979] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:50 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:51.730804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:51.731402 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:51.738256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:51.738701 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:51.739463 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:51.739896 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:51.797679 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:51.805956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-711f5407-853f-49f6-9af4-ce1587baff3f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079060 Mar 08 13:51:51.806509 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1338/2980] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:51 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:52.822393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:52.823028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:52.829479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:52.829880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:52.830815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:52.831248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:52.891091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:52.899312 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-41640f91-6044-452f-bc8e-c2d22248625b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080913 Mar 08 13:51:52.899917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1643/2981] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:52 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:53.915902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:53.916532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:53.923835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:53.924382 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:53.925184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:53.925624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:53.983008 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:53.991279 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-39bb3304-087c-4093-89a5-9f464d71c8e2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079220 Mar 08 13:51:53.991836 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1339/2982] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:53 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:55.008090 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:55.008639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:55.014938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:55.015395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:55.016163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:55.017351 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:55.080591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:55.088331 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-790fe147-e829-4b35-95ef-83408769cb23 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084229 Mar 08 13:51:55.088929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1644/2983] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:55 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:56.105754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:56.106369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:56.112817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:56.113267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:56.114026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:56.114464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:56.175703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:56.183455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-873534f4-0629-47e1-88d9-f99ba2d12676 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081557 Mar 08 13:51:56.184019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1340/2984] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:56 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:57.202880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:57.203880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:57.213217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:57.214017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:57.215252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:57.215950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:57.279627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:57.288005 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-acedabe4-904f-41c8-b307-295cf245ba21 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.091203 Mar 08 13:51:57.288567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1645/2985] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:57 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:58.304704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:58.305297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:58.311563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:58.312019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:58.312813 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:58.313461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:58.374327 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:58.381693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4052fa80-0bef-4ccc-ba7e-7d705bdbab42 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080889 Mar 08 13:51:58.382229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1341/2986] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:58 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:51:59.399162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:51:59.399770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:51:59.405962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:59.406409 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:59.407191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:51:59.407767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:51:59.465959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:51:59.474040 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2ed471f4-6cfd-46be-9546-1527c2469045 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078671 Mar 08 13:51:59.474605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1646/2987] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:51:59 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:00.491438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:00.492050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:00.498322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:00.498770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:00.499533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:00.499966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:00.559801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:00.568266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3263392b-2ca3-48ed-b255-f4038b4ee535 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080701 Mar 08 13:52:00.568890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1342/2988] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:00 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:01.585764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:01.586352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:01.592586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:01.593062 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:01.593813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:01.594388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:01.654949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:01.662747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5a52b656-d95f-4a34-b6f2-e57e255a8ad4 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080820 Mar 08 13:52:01.663322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1647/2989] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:01 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:02.679320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:02.679936 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:02.685804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:02.686249 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:02.687006 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:02.687449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:02.750449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:02.759748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-903fe80b-4188-4954-98d0-324e7a1bb0fb tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.084154 Mar 08 13:52:02.769311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1343/2990] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:02 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:03.776173 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:03.776832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:03.783163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:03.783605 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:03.784358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:03.784818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:03.843162 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:03.851042 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-944b8026-056c-4176-a408-dcd036c723cc tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078687 Mar 08 13:52:03.851594 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1648/2991] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:03 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:04.867472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:04.868081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:04.874325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:04.874767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:04.876103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:04.876537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:04.933843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:04.942100 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-851618f6-a59e-4ad1-81cb-b1448b2a9ec2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078497 Mar 08 13:52:04.942661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1344/2992] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:04 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:05.958589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:05.959186 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:05.965628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:05.966075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:05.966830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:05.967265 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:06.026130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:06.033892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f5944b97-5f5c-4aee-87e5-3235f6f86e01 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079837 Mar 08 13:52:06.034455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1649/2993] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:05 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:07.050682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:07.051272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:07.057580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:07.058030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:07.058798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:07.059234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:07.123209 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:07.125911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-17dbbf3f-6b89-438b-95f6-d08517f5f455 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079375 Mar 08 13:52:07.126469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1345/2994] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:07 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:08.142607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:08.143206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:08.149475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:08.149926 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:08.150692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:08.151130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:08.212577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:08.220905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58022265-73f4-40dc-8ce6-7a5d0a0ebf46 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082145 Mar 08 13:52:08.221473 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1650/2995] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:08 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:09.238292 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:09.238909 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:09.245205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:09.245649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:09.246416 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:09.246849 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:09.308389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:09.316326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7d2d6ad5-0dce-467e-bd83-9b4548970075 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082480 Mar 08 13:52:09.316910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1346/2996] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:09 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:52:10.333034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:10.333643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:10.340049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:10.340503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:10.341299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:10.341740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:10.402079 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:10.410293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8be9e6cf-93f1-4a84-b496-daaabfb20cce tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081111 Mar 08 13:52:10.410850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1651/2997] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:10 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:11.426221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:11.426823 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:11.433136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:11.433581 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:11.434336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:11.434767 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:11.494245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:11.502039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f1e5e4a-5674-4b05-a6ce-b245af5a660d tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079677 Mar 08 13:52:11.502600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1347/2998] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:11 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:12.518817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:12.519410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:12.525713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:12.526163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:12.526925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:12.527364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:12.589226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:12.597914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6991b77c-af51-4038-9940-22b9910c775a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083121 Mar 08 13:52:12.598474 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1652/2999] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:12 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:13.614753 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:13.615370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:13.621607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:13.622057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:13.622809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:13.623242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:13.682260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:13.690479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7cdfc2cd-4133-49a6-96b6-b31d568a76a2 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079863 Mar 08 13:52:13.691038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1348/3000] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:13 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:14.707101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:14.707686 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:14.713485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:14.713931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:14.714683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:14.715113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:14.773376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:14.781075 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-010bf61f-c1cb-4640-ae8d-0079454ede61 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.077996 Mar 08 13:52:14.781635 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1653/3001] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:14 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:15.796880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:15.797520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:15.803927 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:15.804379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:15.805184 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:15.805621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:15.865718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:15.873446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0b52419e-530d-4076-96a2-5a41fee7a1ff tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080503 Mar 08 13:52:15.874003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1349/3002] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:15 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:16.889810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:16.890946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:16.897177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:16.897626 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:16.898382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:16.898812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:16.957662 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:16.965269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cdf85a5e-b846-49ec-9702-39c532ecef19 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079319 Mar 08 13:52:16.965824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1654/3003] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:16 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:17.983052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:17.983676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:17.990135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:17.990586 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:17.991344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:17.991782 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:18.050983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:18.058654 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-34b0a8c5-e460-4616-8103-cc03497969a8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079636 Mar 08 13:52:18.059320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1350/3004] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:17 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:19.075943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:19.076493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:19.083058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:19.083509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:19.084268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:19.084736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:19.147190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:19.154859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ea5328e6-0ee1-47d0-95ba-2188a853f0e8 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082887 Mar 08 13:52:19.155422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1655/3005] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:19 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:20.172120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:20.172850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:20.179140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:20.179579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:20.180327 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:20.180795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:20.239118 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:20.246778 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e0e30dfa-6a83-44fb-8b34-498b4eed735f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079118 Mar 08 13:52:20.247332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1351/3006] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:20 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:21.263501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:21.264098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:21.271857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:21.272310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:21.273095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:21.273537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:21.331901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:21.339587 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-caabaae6-77d2-419d-b582-1e83826dcdaf tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079917 Mar 08 13:52:21.340145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1656/3007] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:21 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:22.357016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:22.357628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:22.364258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:22.364736 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:22.365508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:22.365946 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:22.427511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:22.435185 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6e8203a2-5a3f-4a2c-ada7-2a9bfc942c89 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.082117 Mar 08 13:52:22.435739 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1352/3008] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:22 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:23.452270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:23.453276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:23.459537 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:23.459985 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:23.460771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:23.461213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:23.522551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:23.530338 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fb823bba-10b3-48fd-9ec1-83363cf04d39 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081895 Mar 08 13:52:23.531506 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1657/3009] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:23 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:24.548243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:24.548890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:24.555141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:24.555592 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:24.556356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:24.556831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:24.616180 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:24.623841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-20c271a6-d32f-451b-8a74-8685a0ab0457 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080186 Mar 08 13:52:24.624400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1353/3010] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:24 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:25.641593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:25.642158 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:25.648383 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:25.648870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:25.649639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:25.650108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:25.708745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:25.716291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-37b7cef4-9cda-4cc7-9dc0-0d8ad448d28e tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079681 Mar 08 13:52:25.716881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1658/3011] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:25 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:26.733269 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:26.734618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:26.740915 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:26.741361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:26.742121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:26.742558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:26.801032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:26.809054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e2a109d3-4df0-42ab-94b4-0aba11cf78ae tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079667 Mar 08 13:52:26.809607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1354/3012] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:26 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:27.826462 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:27.827057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:27.833348 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:27.833796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:27.834549 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:27.834980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:27.894831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:27.902419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-42296208-7d59-43c2-82c0-afa282ffed5f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079814 Mar 08 13:52:27.908517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1659/3013] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:27 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:28.919398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:28.920039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:28.926531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:28.926982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:28.927747 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:28.928183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:28.988928 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:28.996607 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f9df9b18-f2b0-464b-8c27-590238fe24aa tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081119 Mar 08 13:52:28.997196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1355/3014] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:28 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:30.013417 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:30.014070 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:30.025658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:30.026113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:30.026892 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:30.027333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:30.086634 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:30.095004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3c420fb6-8d9c-4baf-bfd0-77c869aa1095 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.085454 Mar 08 13:52:30.095565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1660/3015] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:30 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:31.112081 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:31.112628 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:31.118870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:31.119318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:31.120076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:31.120511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:31.178776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:31.186550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-07e41b3d-dc3c-4407-9e74-d8708bbf6376 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.078499 Mar 08 13:52:31.187166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1356/3016] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:31 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:32.204927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:32.205592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:32.211908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:32.212355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:32.213147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:32.213581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:32.275989 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:32.283731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-accafab9-6b4f-435d-a7b1-7a075959f7b7 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083700 Mar 08 13:52:32.284296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1661/3017] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:32 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:33.299931 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:33.300579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:33.306609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:33.307062 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:33.307826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:33.308260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:33.368859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:33.377647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fe2c6a65-f8a7-4b2d-b9ad-90748fb56335 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.081991 Mar 08 13:52:33.378202 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1357/3018] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:33 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:34.394329 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:34.394945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:34.401172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:34.401619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:34.402372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:34.402803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:34.461534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:34.469292 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c69c9645-d895-4f31-a912-bcb08e666556 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079347 Mar 08 13:52:34.469862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1662/3019] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:34 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:35.486379 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:35.486985 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:35.493313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:35.496153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:35.496153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:35.496153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:35.557579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:35.565591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-43d2492a-ab19-481d-9ded-186e066ddd68 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.083781 Mar 08 13:52:35.566150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1358/3020] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:35 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:36.582791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:36.583413 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:36.589641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:36.590091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:36.590848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:36.591284 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:36.650389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:36.658581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bfce7fde-7076-4921-a100-e89f26276d5a tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.079667 Mar 08 13:52:36.659148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1663/3021] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:36 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:37.675821 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:37.676428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:37.682693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:37.683137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:37.683891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:37.684322 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:37.744046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:37.752367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cfa7ec6c-0cb7-4e85-ad46-0417df69f36b tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080592 Mar 08 13:52:37.752961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1359/3022] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:37 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:38.769032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:38.769643 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:38.779939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:38.779939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:38.779939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:38.779939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:38.836779 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:38.845327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e29347cf-5bb5-4eac-a9f1-0fd0689a0f6f tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.080052 Mar 08 13:52:38.845827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1664/3023] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:38 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:39.863548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:39.864166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] [instance: dd6bc389-6db6-4800-b030-7ee0a855e6de] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:39.876237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:39.878077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:39.881832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:39.883076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:39.938708 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1528056693", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "networks": [{"uuid": "f5aad395-b5ce-409d-8195-3c041598c0a7"}]}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:52:39.969820 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '658d1271fb264cb59e62a921492457c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e18e69f500fe484994f99d9e8b599b78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:39.978014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ac1e3235-2d95-459d-bf58-6d966fe31b08 tempest-ServerRescueNegativeTestJSON-870738543 tempest-ServerRescueNegativeTestJSON-870738543-project] 10.222.0.52 "GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de" status: 200 len: 1353 microversion: 2.1 time: 0.119687 Mar 08 13:52:39.985526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1360/3024] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:39 2022] GET /compute/v2.1/servers/dd6bc389-6db6-4800-b030-7ee0a855e6de => generated 1353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:40.006084 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] validate_networks() for [('f5aad395-b5ce-409d-8195-3c041598c0a7', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:52:40.638009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:52:40.638460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:52:40.638943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:52:40.640229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:52:40.640905 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:52:40.656550 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:40.657510 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:40.658586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:40.659304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:40.678860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Getting quotas for project 79b5b498a60248d3aedb25d879c5c923. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:52:40.683308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Getting quotas for user 5f1befc68f5a43c492efef77b1ec480a and project 79b5b498a60248d3aedb25d879c5c923. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:52:40.701798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:52:40.705214 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:52:40.823667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-421c2715-c9cb-433e-8ef5-e9153c9c8ea3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889431 Mar 08 13:52:40.829704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1665/3025] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:52:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:52:40.837115 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-53898dca-045c-434a-8155-a5932c299c53 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:40.838014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-53898dca-045c-434a-8155-a5932c299c53 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:40.918273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-53898dca-045c-434a-8155-a5932c299c53 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:40.927631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-53898dca-045c-434a-8155-a5932c299c53 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1219 microversion: 2.1 time: 0.095958 Mar 08 13:52:40.930386 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1361/3026] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:40 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:41.652645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-5643d9d6-3020-455b-83e0-2a8f10888d3d req-9a50e70e-0bfa-4101-8bdc-09fae3c9f10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb7cf51-102c-4301-941a-338b211f4ddb", "name": "network-vif-deleted", "tag": "9c21a2e3-13f5-49d4-b60f-429cf89734dd"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:52:41.671915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-5643d9d6-3020-455b-83e0-2a8f10888d3d req-9a50e70e-0bfa-4101-8bdc-09fae3c9f10d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:41.672943 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-5643d9d6-3020-455b-83e0-2a8f10888d3d req-9a50e70e-0bfa-4101-8bdc-09fae3c9f10d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:41.683178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-5643d9d6-3020-455b-83e0-2a8f10888d3d req-9a50e70e-0bfa-4101-8bdc-09fae3c9f10d service nova] Creating event network-vif-deleted:9c21a2e3-13f5-49d4-b60f-429cf89734dd for instance 3bb7cf51-102c-4301-941a-338b211f4ddb on hv-cinder-83009 Mar 08 13:52:41.689354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-5643d9d6-3020-455b-83e0-2a8f10888d3d req-9a50e70e-0bfa-4101-8bdc-09fae3c9f10d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094271 Mar 08 13:52:41.690141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1666/3027] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:52:41.945992 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:41.959409 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:41.966353 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:41.966800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:41.970806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:41.971261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:42.038981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:42.047150 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ff3b8de8-4a53-495e-8b88-99c62567d757 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1223 microversion: 2.1 time: 0.105027 Mar 08 13:52:42.049339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1362/3028] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:41 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:43.067390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:43.067914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:43.074629 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:43.075341 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:43.076371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:43.078130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:43.147009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:43.154153 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-89239944-093b-4cb4-9e50-c206e674aead tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1271 microversion: 2.1 time: 0.092488 Mar 08 13:52:43.160795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1667/3029] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:43 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:44.173001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:44.173727 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:44.180921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:44.181568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:44.182397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:44.182870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:44.249232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:44.256449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5dbd0d87-340d-468e-abb9-ca05349deab9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1279 microversion: 2.1 time: 0.088835 Mar 08 13:52:44.257039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1363/3030] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:44 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:45.274374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:45.274996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:45.281912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:45.282366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:45.283148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:45.283592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:45.348941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:45.356179 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e2a91126-d2d2-46c4-a625-296c467577fd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1279 microversion: 2.1 time: 0.086049 Mar 08 13:52:45.356770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1668/3031] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:45 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:45.988136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7878154f-1cb0-4d08-9c2c-156dbaf98eed tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Action: 'create', calling method: .version_select at 0x7f5e2d6ae670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1487129033"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:52:46.373655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:46.374804 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:46.381370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:46.381817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:46.382581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:46.383020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:46.441857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:46.449269 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f9a74372-ebbb-4948-b203-4ad7c760ac7c tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1277 microversion: 2.1 time: 0.079552 Mar 08 13:52:46.449844 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1669/3032] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:46 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1277 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:46.634471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7878154f-1cb0-4d08-9c2c-156dbaf98eed tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.762239 Mar 08 13:52:46.635172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1364/3033] 10.222.0.52 () {60 vars in 1154 bytes} [Tue Mar 8 13:52:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 764 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 13:52:46.646113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8905338b-6285-49fe-b050-31b799cb711b tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d50b4c0>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:46.693744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8905338b-6285-49fe-b050-31b799cb711b tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0" status: 200 len: 345 microversion: 2.1 time: 0.051417 Mar 08 13:52:46.694565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1670/3034] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:52:46 2022] GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:47.411693 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-f8cf636f-8f78-4331-a1de-c34386df43f8 req-0d331221-df45-4737-86e7-081d116a950e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57c86f8-937a-4c94-8401-ca5e27f9266a", "tag": "07464eef-a5eb-4b71-afa0-f48e89711e2e"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:52:47.420806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-f8cf636f-8f78-4331-a1de-c34386df43f8 req-0d331221-df45-4737-86e7-081d116a950e service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:47.425619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-f8cf636f-8f78-4331-a1de-c34386df43f8 req-0d331221-df45-4737-86e7-081d116a950e service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:47.431843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-f8cf636f-8f78-4331-a1de-c34386df43f8 req-0d331221-df45-4737-86e7-081d116a950e service nova] Creating event network-changed:07464eef-a5eb-4b71-afa0-f48e89711e2e for instance f57c86f8-937a-4c94-8401-ca5e27f9266a on hv-cinder-83009 Mar 08 13:52:47.437061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-f8cf636f-8f78-4331-a1de-c34386df43f8 req-0d331221-df45-4737-86e7-081d116a950e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029524 Mar 08 13:52:47.437649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1365/3035] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:47.466501 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:47.467603 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:47.474390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:47.474846 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:47.475625 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:47.476298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:47.616497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:47.624109 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-031da3af-f34b-4eb5-be91-3ab3ed58faaf tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.161748 Mar 08 13:52:47.627142 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1671/3036] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:47 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:52:47.706474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0faa067a-a7cc-4994-b958-b79ad3fd8fba tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d365550>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:47.753722 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0faa067a-a7cc-4994-b958-b79ad3fd8fba tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0" status: 200 len: 346 microversion: 2.1 time: 0.051350 Mar 08 13:52:47.754285 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1366/3037] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:52:47 2022] GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:47.765803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0f1d4370-b8ad-449b-a638-bfbbbaa7973a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Action: 'create', calling method: .version_select at 0x7f5e2d260d30>, body: {"snapshot": {"volume_id": "7e55adf0-9d71-437e-a01f-46127567ecf0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1060400869"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:52:48.260723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0f1d4370-b8ad-449b-a638-bfbbbaa7973a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.498942 Mar 08 13:52:48.261959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1672/3038] 10.222.0.52 () {60 vars in 1161 bytes} [Tue Mar 8 13:52:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:48.271839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cf96e459-f129-4312-854f-f00cfa9bb9bb tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d513820>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:48.301674 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cf96e459-f129-4312-854f-f00cfa9bb9bb tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 200 len: 287 microversion: 2.1 time: 0.033850 Mar 08 13:52:48.302239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1367/3039] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:48 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:48.315820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8e36583d-4ee9-4861-9503-20a05a89531a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d3cd3a0>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:48.349483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8e36583d-4ee9-4861-9503-20a05a89531a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041540 Mar 08 13:52:48.350191 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1673/3040] 10.222.0.52 () {58 vars in 1139 bytes} [Tue Mar 8 13:52:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:48.366442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f38d9607-9b8c-4dab-92ce-c55872cfdc6d tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d3629d0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:48.397661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f38d9607-9b8c-4dab-92ce-c55872cfdc6d tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 200 len: 287 microversion: 2.1 time: 0.041318 Mar 08 13:52:48.398266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1368/3041] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:48 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:48.641950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:48.642551 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:48.649146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:48.649589 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:48.650356 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:48.650790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:48.785154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:48.792440 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-41398d1c-ed80-498a-b4f7-5893c7afcae9 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.155019 Mar 08 13:52:48.793024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1674/3042] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:48 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:49.410577 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1c1270ff-fbc9-4888-b39c-9c7277a5ad4a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d6ae280>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:49.439068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1c1270ff-fbc9-4888-b39c-9c7277a5ad4a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 200 len: 287 microversion: 2.1 time: 0.032648 Mar 08 13:52:49.439633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1369/3043] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:49 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:49.809865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:49.810463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:49.817457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:49.817914 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:49.818731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:49.819175 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:49.948301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:49.956432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c52ea2a7-bc33-4643-9588-f5de08f1b1ba tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.150477 Mar 08 13:52:49.957034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1675/3044] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:49 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:50.450073 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-76aa95a9-099a-4e05-b0d9-b19b870798e4 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d513820>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:50.478288 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-76aa95a9-099a-4e05-b0d9-b19b870798e4 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 200 len: 287 microversion: 2.1 time: 0.032372 Mar 08 13:52:50.478877 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1370/3045] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:50 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:50.972757 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:50.973365 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:50.979633 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:50.980058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:50.980855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:50.981294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:51.110941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:51.118030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-aedbb93f-4dc2-46d2-a4b1-dde5608086dd tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.149492 Mar 08 13:52:51.118593 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1676/3046] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:50 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:51.489655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6e0388d5-796f-4260-b2e8-c1d0b95ea0ac tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d2eda60>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:51.519360 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6e0388d5-796f-4260-b2e8-c1d0b95ea0ac tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 200 len: 287 microversion: 2.1 time: 0.033846 Mar 08 13:52:51.519993 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1371/3047] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:51 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:52.134977 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:52.135595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:52.142007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:52.142460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:52.143221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:52.143656 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:52.279811 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:52.287098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-60df3a5a-87cc-4ed1-8414-4b50313febb8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.156146 Mar 08 13:52:52.287667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1677/3048] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:52 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:52.531835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0812efa2-4194-4928-8447-dbb399f64bcd tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d2cf3a0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:52.568278 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0812efa2-4194-4928-8447-dbb399f64bcd tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 200 len: 288 microversion: 2.1 time: 0.041449 Mar 08 13:52:52.569014 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1372/3049] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:52 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:52:52.579148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-171e90aa-688b-4d13-bb70-7364f2c984ed tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d41d040>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:52.865907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-171e90aa-688b-4d13-bb70-7364f2c984ed tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 202 len: 0 microversion: 2.1 time: 0.288301 Mar 08 13:52:52.865907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1678/3050] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Mar 8 13:52:52 2022] DELETE /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:52:52.872529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d76488d2-6aa0-4315-9537-6492738c10f0 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d365550>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:52.900616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d76488d2-6aa0-4315-9537-6492738c10f0 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 200 len: 287 microversion: 2.1 time: 0.031905 Mar 08 13:52:52.901229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1373/3051] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:52 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:52:53.304536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:53.305190 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:53.311087 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:53.311517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:53.312270 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:53.312834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:53.449370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:53.457101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7d5348b3-b7a9-4c6e-8a76-54be4795122f tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.156722 Mar 08 13:52:53.457694 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1679/3052] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:53 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:53.913768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a823c97-54dc-40fd-ba89-857d2e0d3b65 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d2edf70>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:53.939230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-6a823c97-54dc-40fd-ba89-857d2e0d3b65 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] HTTP exception thrown: Snapshot 6862e6e3-ca48-4b12-883b-aeecce47d46f could not be found. Mar 08 13:52:53.939839 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a823c97-54dc-40fd-ba89-857d2e0d3b65 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Returning 404 to user: Snapshot 6862e6e3-ca48-4b12-883b-aeecce47d46f could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:52:53.941142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a823c97-54dc-40fd-ba89-857d2e0d3b65 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f" status: 404 len: 111 microversion: 2.1 time: 0.031406 Mar 08 13:52:53.941707 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1374/3053] 10.222.0.52 () {58 vars in 1250 bytes} [Tue Mar 8 13:52:53 2022] GET /compute/v2.1/os-snapshots/6862e6e3-ca48-4b12-883b-aeecce47d46f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:52:53.949560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a1406d35-9d15-4e4e-98b6-63f86e68def0 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d260f70>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:54.121719 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a1406d35-9d15-4e4e-98b6-63f86e68def0 tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0" status: 202 len: 0 microversion: 2.1 time: 0.175955 Mar 08 13:52:54.122305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1680/3054] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:52:53 2022] DELETE /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:52:54.130921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c6c82f46-96f3-464a-a3ee-e6b6345e721a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d2cf550>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:54.181108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c6c82f46-96f3-464a-a3ee-e6b6345e721a tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0" status: 200 len: 345 microversion: 2.1 time: 0.053868 Mar 08 13:52:54.181672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1375/3055] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:52:54 2022] GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:52:54.475056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:54.475793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:54.481683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:54.482210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:54.483646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:54.484093 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:54.636684 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:54.650334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-47cfebba-e88e-4b13-a4da-f34eb75db620 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.178516 Mar 08 13:52:54.650917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1681/3056] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:54 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:55.197517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-33b194b3-5939-4c17-94d9-f5b6debbd82f tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d2edb80>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:55.224780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-33b194b3-5939-4c17-94d9-f5b6debbd82f tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] HTTP exception thrown: Volume 7e55adf0-9d71-437e-a01f-46127567ecf0 could not be found. Mar 08 13:52:55.225380 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-33b194b3-5939-4c17-94d9-f5b6debbd82f tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Returning 404 to user: Volume 7e55adf0-9d71-437e-a01f-46127567ecf0 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:52:55.226210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-33b194b3-5939-4c17-94d9-f5b6debbd82f tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0" status: 404 len: 109 microversion: 2.1 time: 0.033097 Mar 08 13:52:55.226756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1376/3057] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:52:55 2022] GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:52:55.240993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5f1e1941-542f-4c6d-a01b-bb578417928e tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e2d54ba60>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:55.268201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-5f1e1941-542f-4c6d-a01b-bb578417928e tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] HTTP exception thrown: Volume 7e55adf0-9d71-437e-a01f-46127567ecf0 could not be found. Mar 08 13:52:55.268904 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5f1e1941-542f-4c6d-a01b-bb578417928e tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Returning 404 to user: Volume 7e55adf0-9d71-437e-a01f-46127567ecf0 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:52:55.269761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5f1e1941-542f-4c6d-a01b-bb578417928e tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0" status: 404 len: 109 microversion: 2.1 time: 0.032737 Mar 08 13:52:55.270293 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1682/3058] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:52:55 2022] DELETE /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:52:55.278233 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f9f9ad92-5494-4496-9a7b-24812326e2ea tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Calling method '.version_select at 0x7f5e31f989d0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:55.307668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-f9f9ad92-5494-4496-9a7b-24812326e2ea tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] HTTP exception thrown: Volume 7e55adf0-9d71-437e-a01f-46127567ecf0 could not be found. Mar 08 13:52:55.309026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f9f9ad92-5494-4496-9a7b-24812326e2ea tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] Returning 404 to user: Volume 7e55adf0-9d71-437e-a01f-46127567ecf0 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:52:55.309294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f9f9ad92-5494-4496-9a7b-24812326e2ea tempest-VolumesSnapshotsTestJSON-1442514770 tempest-VolumesSnapshotsTestJSON-1442514770-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0" status: 404 len: 109 microversion: 2.1 time: 0.034967 Mar 08 13:52:55.309961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1377/3059] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 13:52:55 2022] GET /compute/v2.1/os-volumes/7e55adf0-9d71-437e-a01f-46127567ecf0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:52:55.670273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:55.671679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:55.680125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:55.680952 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:55.683146 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:55.683832 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:55.864937 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:55.872283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d51cff04-7b9e-4849-a763-67c686342335 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.208936 Mar 08 13:52:55.872906 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1683/3060] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:55 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:56.011344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-0431cfea-10d7-437f-a484-b31181372706 req-1153042f-8a04-40b2-aab2-e36a50ffc749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57c86f8-937a-4c94-8401-ca5e27f9266a", "name": "network-vif-plugged", "status": "completed", "tag": "07464eef-a5eb-4b71-afa0-f48e89711e2e"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:52:56.020229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-0431cfea-10d7-437f-a484-b31181372706 req-1153042f-8a04-40b2-aab2-e36a50ffc749 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:56.020716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-0431cfea-10d7-437f-a484-b31181372706 req-1153042f-8a04-40b2-aab2-e36a50ffc749 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:56.031765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-0431cfea-10d7-437f-a484-b31181372706 req-1153042f-8a04-40b2-aab2-e36a50ffc749 service nova] Creating event network-vif-plugged:07464eef-a5eb-4b71-afa0-f48e89711e2e for instance f57c86f8-937a-4c94-8401-ca5e27f9266a on hv-cinder-83009 Mar 08 13:52:56.036796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-0431cfea-10d7-437f-a484-b31181372706 req-1153042f-8a04-40b2-aab2-e36a50ffc749 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029083 Mar 08 13:52:56.037756 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1378/3061] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:52:56.892689 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:56.893928 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:56.901919 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:56.904945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:56.904945 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:56.905202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:57.054068 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:57.061883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bf74dfbd-788e-47e3-927c-c221f0541b6d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1319 microversion: 2.1 time: 0.176137 Mar 08 13:52:57.062455 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1684/3062] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:56 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:58.082031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:52:58.083784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:58.090316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:58.090770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:58.091613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:58.092065 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:58.277099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:52:58.285375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6a981c5b-77d8-4c96-8c0d-1d58f1a09fe0 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1508 microversion: 2.1 time: 0.207474 Mar 08 13:52:58.286102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1379/3063] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:52:58 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:52:58.302467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-db6bcd2d-3c86-48dd-9739-31480eb3e877 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8b7523e-8fe8-4d48-9b0b-6148d273c6f6", "device": "/dev/sdb"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:52:58.304870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-db6bcd2d-3c86-48dd-9739-31480eb3e877 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:52:58.324901 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db6bcd2d-3c86-48dd-9739-31480eb3e877 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:58.327072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db6bcd2d-3c86-48dd-9739-31480eb3e877 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:58.327072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db6bcd2d-3c86-48dd-9739-31480eb3e877 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:52:58.330415 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-db6bcd2d-3c86-48dd-9739-31480eb3e877 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:52:59.141657 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-db6bcd2d-3c86-48dd-9739-31480eb3e877 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "POST /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843316 Mar 08 13:52:59.142602 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1685/3064] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:52:58 2022] POST /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a/os-volume_attachments => generated 194 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:53:20.664754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:20.664754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:20.670414 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:20.670865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:20.671633 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:20.672069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:20.754334 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'services' on Instance uuid f57c86f8-937a-4c94-8401-ca5e27f9266a {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:53:21.052592 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-86996151-ba8f-4382-ae9b-f96fe0aa1cff tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Action: 'create', calling method: .version_select at 0x7f5e2d5638b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1453283883"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:53:21.063786 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9d3346a6-e484-4d3a-b399-5541f3ac84d3 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a/os-volume_attachments/f8b7523e-8fe8-4d48-9b0b-6148d273c6f6" status: 202 len: 0 microversion: 2.1 time: 0.404409 Mar 08 13:53:21.064791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1380/3065] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:53:20 2022] DELETE /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a/os-volume_attachments/f8b7523e-8fe8-4d48-9b0b-6148d273c6f6 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:53:21.075990 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-86996151-ba8f-4382-ae9b-f96fe0aa1cff tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Getting quotas for project eab8d126a4574df48a127b8c3a03b20d. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:53:21.078802 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-86996151-ba8f-4382-ae9b-f96fe0aa1cff tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Getting quotas for user f88b139b7ac7488c9b48216350775c71 and project eab8d126a4574df48a127b8c3a03b20d. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:53:21.616956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-86996151-ba8f-4382-ae9b-f96fe0aa1cff tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Getting quotas for project eab8d126a4574df48a127b8c3a03b20d. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:53:21.620498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-86996151-ba8f-4382-ae9b-f96fe0aa1cff tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Getting quotas for user f88b139b7ac7488c9b48216350775c71 and project eab8d126a4574df48a127b8c3a03b20d. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:53:21.634108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-86996151-ba8f-4382-ae9b-f96fe0aa1cff tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.585757 Mar 08 13:53:21.634698 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1686/3066] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:53:21 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:53:21.742230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1454005709", "imageRef": "02d4f33f-2721-4f66-87b1-a0ac381eca02", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1453283883", "networks": [{"uuid": "e567aa04-39d9-43bc-a154-6e2362942454"}]}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:53:21.793381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.network.neutron [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] validate_networks() for [('e567aa04-39d9-43bc-a154-6e2362942454', None, None, None, None, None)] {{(pid=117282) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:53:22.193363 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:22.194860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:22.202853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:22.203615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:22.204458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:22.204941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:22.232204 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Going to try to terminate instance {{(pid=117280) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:53:22.288302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Flavor limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:53:22.288904 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Image limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:53:22.289503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Flavor pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:53:22.289922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Image pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:53:22.290371 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:53:22.299919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:22.300364 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:22.301277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:22.301717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:22.318808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Getting quotas for project eab8d126a4574df48a127b8c3a03b20d. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:53:22.322906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Getting quotas for user f88b139b7ac7488c9b48216350775c71 and project eab8d126a4574df48a127b8c3a03b20d. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:53:22.334476 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Going to run 1 instances... {{(pid=117282) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:53:22.336789 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02d4f33f-2721-4f66-87b1-a0ac381eca02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:53:22.501068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f68ffa39-c7a2-4c3a-8ae6-6edb51c78446 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763373 Mar 08 13:53:22.501717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1381/3067] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:53:22.511138 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c8639cd2-c119-45e7-816c-4229db4f2066 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:22.511749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c8639cd2-c119-45e7-816c-4229db4f2066 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:22.568950 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c8639cd2-c119-45e7-816c-4229db4f2066 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:22.575591 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c8639cd2-c119-45e7-816c-4229db4f2066 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1259 microversion: 2.1 time: 0.068032 Mar 08 13:53:22.576256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1382/3068] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:22 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:53:22.607530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f652c722-a64c-45ed-b520-5a33c6b69714 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 204 len: 0 microversion: 2.1 time: 0.418293 Mar 08 13:53:22.608120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1687/3069] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:53:22 2022] DELETE /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 13:53:22.616047 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:22.616646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:22.625466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:22.625911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:22.627773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:22.627773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:22.765795 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:22.772991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d3c903eb-d7dd-4020-a6ab-3c3fbb351b3d tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1514 microversion: 2.1 time: 0.160674 Mar 08 13:53:22.773551 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1383/3070] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:22 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:23.593976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1ad9f664-f3b1-4113-865a-ac11a0cc91df tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:23.594679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1ad9f664-f3b1-4113-865a-ac11a0cc91df tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:23.651426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1ad9f664-f3b1-4113-865a-ac11a0cc91df tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:23.659366 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1ad9f664-f3b1-4113-865a-ac11a0cc91df tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1259 microversion: 2.1 time: 0.070400 Mar 08 13:53:23.659911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1688/3071] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:23 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:23.790787 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:23.791410 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:23.798259 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:23.798705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:23.799465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:23.799988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:23.933440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:23.940769 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9f89056d-b915-4c17-ac24-e68c24cc0bf4 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1514 microversion: 2.1 time: 0.153829 Mar 08 13:53:23.941398 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1384/3072] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:23 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:24.675289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-25108430-b659-4df0-8650-7ff397c711bc tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:24.676454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-25108430-b659-4df0-8650-7ff397c711bc tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:24.730095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-25108430-b659-4df0-8650-7ff397c711bc tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:24.737297 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-25108430-b659-4df0-8650-7ff397c711bc tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1259 microversion: 2.1 time: 0.065736 Mar 08 13:53:24.740585 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1689/3073] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:24 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:24.959583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:24.960315 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:24.968482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:24.968975 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:24.969768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:24.970469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:25.117203 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:25.126437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-577023a5-540e-465d-8de4-5f8f0214d78e tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1514 microversion: 2.1 time: 0.170903 Mar 08 13:53:25.136923 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1385/3074] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:24 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:25.207149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-fcfc0a71-fcb5-47d5-b243-5c2998f902d9 req-28924894-6909-4546-b8ee-318a5b8743d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57c86f8-937a-4c94-8401-ca5e27f9266a", "name": "network-vif-deleted", "tag": "07464eef-a5eb-4b71-afa0-f48e89711e2e"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:53:25.215518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-fcfc0a71-fcb5-47d5-b243-5c2998f902d9 req-28924894-6909-4546-b8ee-318a5b8743d7 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:25.215971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-fcfc0a71-fcb5-47d5-b243-5c2998f902d9 req-28924894-6909-4546-b8ee-318a5b8743d7 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:25.226385 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-fcfc0a71-fcb5-47d5-b243-5c2998f902d9 req-28924894-6909-4546-b8ee-318a5b8743d7 service nova] Creating event network-vif-deleted:07464eef-a5eb-4b71-afa0-f48e89711e2e for instance f57c86f8-937a-4c94-8401-ca5e27f9266a on hv-cinder-83009 Mar 08 13:53:25.231812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-fcfc0a71-fcb5-47d5-b243-5c2998f902d9 req-28924894-6909-4546-b8ee-318a5b8743d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028234 Mar 08 13:53:25.232758 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1690/3075] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:53:25.754456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b8940e37-1ebf-4222-8e3c-a6afbd95eba1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:25.755157 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b8940e37-1ebf-4222-8e3c-a6afbd95eba1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:25.807764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b8940e37-1ebf-4222-8e3c-a6afbd95eba1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:25.815558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b8940e37-1ebf-4222-8e3c-a6afbd95eba1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1259 microversion: 2.1 time: 0.064951 Mar 08 13:53:25.816147 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1386/3076] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:25 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:26.150619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:26.151358 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:26.160060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:26.160508 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:26.161310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:26.161743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:26.192248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:26.192716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:26.193168 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lazy-loading 'fault' on Instance uuid f57c86f8-937a-4c94-8401-ca5e27f9266a {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:53:26.234717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f1befc68f5a43c492efef77b1ec480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b5b498a60248d3aedb25d879c5c923', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:26.241676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f8ad0672-badc-4f6a-bf0a-2b158fc185d1 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 200 len: 1309 microversion: 2.1 time: 0.100238 Mar 08 13:53:26.242259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1691/3077] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:26 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:26.831770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:26.836354 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:26.838648 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:26.839090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:26.839840 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:26.840312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:26.904781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:26.911996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5d96d2e9-4936-465f-ad37-2b038aae6503 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1263 microversion: 2.1 time: 0.084065 Mar 08 13:53:26.912550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1387/3078] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:26 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:27.259444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:27.260055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] [instance: f57c86f8-937a-4c94-8401-ca5e27f9266a] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:27.267141 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:27.267590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:27.268353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:27.268866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:27.281524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] HTTP exception thrown: Instance f57c86f8-937a-4c94-8401-ca5e27f9266a could not be found. Mar 08 13:53:27.289305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] Returning 404 to user: Instance f57c86f8-937a-4c94-8401-ca5e27f9266a could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:53:27.289305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-94579f06-936e-4ff0-b649-7750b91e33f8 tempest-VolumesSnapshotTestJSON-316322996 tempest-VolumesSnapshotTestJSON-316322996-project] 10.222.0.52 "GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a" status: 404 len: 111 microversion: 2.1 time: 0.027478 Mar 08 13:53:27.289305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1692/3079] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:27 2022] GET /compute/v2.1/servers/f57c86f8-937a-4c94-8401-ca5e27f9266a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:53:27.929441 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:27.930050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:27.945329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:27.946027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:27.950313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:27.950313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:28.010861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:28.019158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9fc459e9-832e-4131-855d-d27dfe274de0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1263 microversion: 2.1 time: 0.093776 Mar 08 13:53:28.019710 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1388/3080] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:27 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:29.035824 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:29.036426 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:29.042727 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:29.043212 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:29.044561 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:29.045022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:29.107393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:29.114742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f9649058-aa17-4367-8bd5-a721950950a9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1311 microversion: 2.1 time: 0.082898 Mar 08 13:53:29.115316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1693/3081] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:29 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:30.132556 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:30.133890 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:30.142432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:30.143438 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:30.144470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:30.145304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:30.376367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:30.383956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fa601e14-ff9d-47a5-b006-eb5cbb932e66 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.256128 Mar 08 13:53:30.384533 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1389/3082] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:30 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:31.400864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:31.401504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:31.411511 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:31.411960 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:31.412774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:31.413211 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:31.566688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:31.576263 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d8bd577e-16ed-42a7-b0f5-4217a80d8c91 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.179059 Mar 08 13:53:31.577220 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1694/3083] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:31 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:32.596191 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:32.597099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:32.603242 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:32.603614 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:32.604388 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:32.604861 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:32.762785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:32.770160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-88b18457-0532-4825-b6b5-784e26e01ae4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.178736 Mar 08 13:53:32.770919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1390/3084] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:32 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:53:33.787681 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:33.788278 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:33.795639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:33.796086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:33.796942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:33.797374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:33.939247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:33.948984 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b85e56be-c3b4-41d1-b28b-789a76c64cec tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.165181 Mar 08 13:53:33.949968 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1695/3085] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:33 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:34.970597 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:34.972012 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:34.979254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:34.979791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:34.981645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:34.982333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:35.163261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:35.172035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b5658553-c7f1-4b56-b150-cb2b47f2e5e4 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.207557 Mar 08 13:53:35.172624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1391/3086] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:34 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:36.190820 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:36.191667 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:36.203235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:36.203717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:36.204479 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:36.204938 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:36.389745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:36.394622 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e18b04a7-84c0-401c-94df-219662ff3944 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.208736 Mar 08 13:53:36.395207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1696/3087] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:36 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:37.417277 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:37.419132 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:37.427588 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:37.429258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:37.430340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:37.431179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:37.619575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:37.629963 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3aeffb9e-1f15-4897-afa6-f29cf6834c38 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.216558 Mar 08 13:53:37.638862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1392/3088] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:37 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:53:38.664729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:38.666104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:38.685102 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:38.688447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:38.688447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:38.688447 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:38.961347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:38.970083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1afc2ff9-2d8b-4371-9fcd-5d62cc9c3d53 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.326162 Mar 08 13:53:38.971982 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1697/3089] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:38 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:39.987320 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:39.988020 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:39.994314 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:39.994765 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:39.995534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:39.996520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:40.144361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:40.152720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-02b6f8a6-f863-45c1-aad3-c5247db87825 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.168890 Mar 08 13:53:40.153448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1393/3090] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:39 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:41.123271 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-0f7a3bc1-4fea-4d7e-8d72-a3bce460934c req-a72e0521-413a-4c8f-9e70-2bf2a6d30930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939642ef-c94a-4884-bd7d-90a70997c3eb", "tag": "c74023ab-27a9-418b-ad7e-3db1b734ce1d"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:53:41.154410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-0f7a3bc1-4fea-4d7e-8d72-a3bce460934c req-a72e0521-413a-4c8f-9e70-2bf2a6d30930 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:41.154859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-0f7a3bc1-4fea-4d7e-8d72-a3bce460934c req-a72e0521-413a-4c8f-9e70-2bf2a6d30930 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:41.166722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-0f7a3bc1-4fea-4d7e-8d72-a3bce460934c req-a72e0521-413a-4c8f-9e70-2bf2a6d30930 service nova] Creating event network-changed:c74023ab-27a9-418b-ad7e-3db1b734ce1d for instance 939642ef-c94a-4884-bd7d-90a70997c3eb on hv-cinder-83009 Mar 08 13:53:41.174897 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:41.175517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:41.189453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:41.191137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:41.191137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:41.191137 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:41.195194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-0f7a3bc1-4fea-4d7e-8d72-a3bce460934c req-a72e0521-413a-4c8f-9e70-2bf2a6d30930 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075428 Mar 08 13:53:41.195809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1698/3091] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:53:41.461176 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:41.471831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0a456068-6b6c-4c9c-aef0-7e99e564e25f tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.297881 Mar 08 13:53:41.471831 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1394/3092] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:41 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:42.485702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:42.486396 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:42.493159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:42.493612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:42.494475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:42.495486 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:42.641971 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:42.649296 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-77c3a52c-3049-466b-b2af-0365a8a9f312 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.167943 Mar 08 13:53:42.649882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1699/3093] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:42 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:53:43.666600 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:43.667205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:43.674055 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:43.677980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:43.677980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:43.677980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:43.810609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:43.817781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d0caf36f-747f-42c9-873e-dd0ea36dc0e3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.154977 Mar 08 13:53:43.818336 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1395/3094] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:43 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:44.834882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:44.835527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:44.842169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:44.842619 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:44.843381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:44.843819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:44.975794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:44.983020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ef9f9401-1fab-41de-b121-171cfac89d71 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.151976 Mar 08 13:53:44.983576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1700/3095] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:44 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:46.001072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:46.001692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:46.007764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:46.008348 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:46.009443 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:46.009807 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:46.141758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:46.148964 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7b0d6296-e4ba-495b-9999-c90bef92ef6c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.153160 Mar 08 13:53:46.149523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1396/3096] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:45 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:47.166063 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:47.166791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:47.173714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:47.174458 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:47.175343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:47.175785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:47.310650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:47.318024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-64df821c-9c85-4c07-911f-aa47071da4f9 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.155818 Mar 08 13:53:47.318529 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1701/3097] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:47 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:48.334939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:48.336156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:48.343046 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:48.343506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:48.344319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:48.345041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:48.480708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:48.488467 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2b6ee755-7793-45c9-817b-d0521df5aa3e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.157562 Mar 08 13:53:48.489303 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1397/3098] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:48 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:49.504814 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:49.505428 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:49.512880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:49.514577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:49.514577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:49.514577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:49.648300 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:49.657198 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-04e34759-b2cd-42ce-8e72-720940fb7e24 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.156152 Mar 08 13:53:49.658187 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1702/3099] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:49 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:50.290087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-e457b222-4337-42f9-8610-9b9d0e2cce89 req-d88ffddd-15ce-425b-8ec8-9a04ff9849fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939642ef-c94a-4884-bd7d-90a70997c3eb", "name": "network-vif-plugged", "status": "completed", "tag": "c74023ab-27a9-418b-ad7e-3db1b734ce1d"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:53:50.301129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-e457b222-4337-42f9-8610-9b9d0e2cce89 req-d88ffddd-15ce-425b-8ec8-9a04ff9849fb service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:50.310797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-e457b222-4337-42f9-8610-9b9d0e2cce89 req-d88ffddd-15ce-425b-8ec8-9a04ff9849fb service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:50.314453 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-e457b222-4337-42f9-8610-9b9d0e2cce89 req-d88ffddd-15ce-425b-8ec8-9a04ff9849fb service nova] Creating event network-vif-plugged:c74023ab-27a9-418b-ad7e-3db1b734ce1d for instance 939642ef-c94a-4884-bd7d-90a70997c3eb on hv-cinder-83009 Mar 08 13:53:50.319887 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-e457b222-4337-42f9-8610-9b9d0e2cce89 req-d88ffddd-15ce-425b-8ec8-9a04ff9849fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033593 Mar 08 13:53:50.320920 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1398/3100] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:53:50.673726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:50.674454 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:50.680896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:50.681339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:50.682125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:50.682566 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:50.825451 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:50.832855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2774e137-7c50-4538-b668-96ca02ec4bd6 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.163050 Mar 08 13:53:50.833423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1703/3101] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:50 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:51.850910 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:51.851658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:51.858652 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:51.859101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:51.859911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:51.860351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:51.998565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:52.005677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c27842d4-966e-4cbb-a733-e24ecabbb09d tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1359 microversion: 2.1 time: 0.159660 Mar 08 13:53:52.006231 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1399/3102] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:51 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:53.022946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:53.023664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:53.030171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.030612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.031407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.031840 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.162522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:53.170771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-dde33487-61e3-4eb1-95f7-58cd7170fa1c tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1549 microversion: 2.1 time: 0.151901 Mar 08 13:53:53.171389 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1704/3103] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:53 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:53.187253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:53.187865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:53.194306 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.194798 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.195560 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.195998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.329859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:53.337142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5eda3aa4-9363-4dc3-8136-53c447acafad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1549 microversion: 2.1 time: 0.154313 Mar 08 13:53:53.337703 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1400/3104] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:53 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:53.353239 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:53.357177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:53.357980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Searching by: {'deleted': False, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d'} {{(pid=117280) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 08 13:53:53.364540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.364962 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.365759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.366194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.455024 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.multi_cell_list [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117280) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 08 13:53:53.548864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-95c5aac7-0cda-4fe0-a44e-25f4b29a1919 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199263 Mar 08 13:53:53.549497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1705/3105] 10.222.0.52 () {58 vars in 1124 bytes} [Tue Mar 8 13:53:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:53:53.560793 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:53:53.561412 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:53.567261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.567698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.568469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:53.568932 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:53.700729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:53:53.708049 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b9f06397-29b5-4944-b5ff-fb4128c4e357 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1549 microversion: 2.1 time: 0.152503 Mar 08 13:53:53.708611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1401/3106] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:53:53 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:53:55.805442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7358bd59-1bc5-4544-99b4-476fcf67b946 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10db924c-a4d3-4be8-b25c-3a6c6a4bfd8e"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:53:55.806489 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7358bd59-1bc5-4544-99b4-476fcf67b946 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:53:55.812785 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7358bd59-1bc5-4544-99b4-476fcf67b946 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:55.813238 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7358bd59-1bc5-4544-99b4-476fcf67b946 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:55.814007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7358bd59-1bc5-4544-99b4-476fcf67b946 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:53:55.814450 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7358bd59-1bc5-4544-99b4-476fcf67b946 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:53:56.649448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7358bd59-1bc5-4544-99b4-476fcf67b946 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847647 Mar 08 13:53:56.650052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1706/3107] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:53:55 2022] POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:54:04.165435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:04.166040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:04.171970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:04.172446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:04.173230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:04.173661 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:04.310720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:04.318743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f62e4954-85f3-4a96-ab73-f38ba43ef280 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1595 microversion: 2.1 time: 0.157201 Mar 08 13:54:04.319307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1402/3108] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:04 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:06.837335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-6ecfd7e3-efb1-43f1-92d0-c7eb5c26cfc6 req-1cc39546-ac27-4a72-983c-7e8be9b85103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939642ef-c94a-4884-bd7d-90a70997c3eb", "tag": "c74023ab-27a9-418b-ad7e-3db1b734ce1d"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:54:06.849856 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-6ecfd7e3-efb1-43f1-92d0-c7eb5c26cfc6 req-1cc39546-ac27-4a72-983c-7e8be9b85103 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:06.850391 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-6ecfd7e3-efb1-43f1-92d0-c7eb5c26cfc6 req-1cc39546-ac27-4a72-983c-7e8be9b85103 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:06.862094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-6ecfd7e3-efb1-43f1-92d0-c7eb5c26cfc6 req-1cc39546-ac27-4a72-983c-7e8be9b85103 service nova] Creating event network-changed:c74023ab-27a9-418b-ad7e-3db1b734ce1d for instance 939642ef-c94a-4884-bd7d-90a70997c3eb on hv-cinder-83009 Mar 08 13:54:06.867111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-6ecfd7e3-efb1-43f1-92d0-c7eb5c26cfc6 req-1cc39546-ac27-4a72-983c-7e8be9b85103 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045394 Mar 08 13:54:06.867916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1707/3109] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:54:09.106604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1209015235"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:54:09.107141 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:09.113503 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:09.113948 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:09.114704 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:09.115135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:09.243479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.network.security_group_api [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Adding security group c6f75071-d40e-4b9b-b23c-23c7a908720e to port c74023ab-27a9-418b-ad7e-3db1b734ce1d Mar 08 13:54:09.280156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:54:09.283859 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:54:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/action (ip 10.222.0.52) !!! Mar 08 13:54:09.659958 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d57df6aa-c6ba-4921-806b-1324d782a01b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/action" status: 202 len: 0 microversion: 2.1 time: 0.557679 Mar 08 13:54:09.660627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1403/3110] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:54:09 2022] POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:54:09.674696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:09.675663 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:09.678365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-76bdba3a-a311-4677-b3ea-de27cea6a009 req-900fec33-69f3-4661-bbed-7e10c70f2bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939642ef-c94a-4884-bd7d-90a70997c3eb", "tag": "c74023ab-27a9-418b-ad7e-3db1b734ce1d"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:54:09.690259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:09.692976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:09.700704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:09.700704 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:09.703828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-76bdba3a-a311-4677-b3ea-de27cea6a009 req-900fec33-69f3-4661-bbed-7e10c70f2bb3 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:09.703828 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-76bdba3a-a311-4677-b3ea-de27cea6a009 req-900fec33-69f3-4661-bbed-7e10c70f2bb3 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:09.723593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-76bdba3a-a311-4677-b3ea-de27cea6a009 req-900fec33-69f3-4661-bbed-7e10c70f2bb3 service nova] Creating event network-changed:c74023ab-27a9-418b-ad7e-3db1b734ce1d for instance 939642ef-c94a-4884-bd7d-90a70997c3eb on hv-cinder-83009 Mar 08 13:54:09.730748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-76bdba3a-a311-4677-b3ea-de27cea6a009 req-900fec33-69f3-4661-bbed-7e10c70f2bb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060696 Mar 08 13:54:09.732844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1404/3111] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:54:09.909456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:09.909456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-10fb199e-f3c3-409c-84ac-362f3057e08a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1761 microversion: 2.1 time: 0.232941 Mar 08 13:54:09.909456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1708/3112] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:09 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1761 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:26.902342 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-87a30881-5ff0-48e4-8260-fbd9af3dbfd7 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:54:26.903367 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-87a30881-5ff0-48e4-8260-fbd9af3dbfd7 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:26.909870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87a30881-5ff0-48e4-8260-fbd9af3dbfd7 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:26.910313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87a30881-5ff0-48e4-8260-fbd9af3dbfd7 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:26.911089 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87a30881-5ff0-48e4-8260-fbd9af3dbfd7 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:26.911529 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-87a30881-5ff0-48e4-8260-fbd9af3dbfd7 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:27.139449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-87a30881-5ff0-48e4-8260-fbd9af3dbfd7 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/action" status: 202 len: 0 microversion: 2.1 time: 0.247263 Mar 08 13:54:27.140370 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1405/3113] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:54:26 2022] POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:54:27.148003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:27.148607 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:27.156072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:27.156516 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:27.157336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:27.157776 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:27.305304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:27.313215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-574cb9ef-03ef-4a7b-b585-842500463b96 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1753 microversion: 2.1 time: 0.169105 Mar 08 13:54:27.313784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1709/3114] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:27 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:28.331346 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:28.332041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:28.338532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:28.338976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:28.339731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:28.340159 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:28.486223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:28.494070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-057ad25f-ae21-4ff7-835c-a7fdb0453740 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.167373 Mar 08 13:54:28.494629 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1406/3115] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:28 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:29.511572 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:29.512177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:29.518431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:29.518874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:29.519627 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:29.520056 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:29.666967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:29.674747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-93ed7d3c-f309-48e3-ad14-839f0b264ce5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.167646 Mar 08 13:54:29.675308 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1710/3116] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:29 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:30.692048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:30.692688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:30.699003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:30.699464 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:30.700224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:30.700678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:30.844833 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:30.852547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6d6ba9c5-5bbb-4991-8fa6-19a6c46ca913 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.164415 Mar 08 13:54:30.853623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1407/3117] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:30 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:31.870560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:31.871164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:31.877367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:31.877812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:31.878568 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:31.879000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:32.019313 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:32.027388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-553baa41-5628-40dd-a57f-7f5ff2b7b3a5 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.161203 Mar 08 13:54:32.027949 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1711/3118] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:31 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:33.043579 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:33.044133 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:33.050027 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:33.050475 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:33.051237 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:33.051676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:33.194128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:33.201882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-401b1d8b-3cd3-493a-a3ed-b93416026b19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.162556 Mar 08 13:54:33.202434 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1408/3119] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:33 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:34.219235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:34.219861 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:34.225980 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:34.226427 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:34.227188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:34.227645 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:34.376931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:34.385418 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-72065436-2cfa-4e20-b4ea-70c12019ae9a tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.170262 Mar 08 13:54:34.385983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1712/3120] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:34 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:35.402458 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:35.403067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:35.409550 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:35.410102 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:35.410781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:35.411220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:35.560076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:35.567780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-46ed08f5-c801-4dcf-a93c-b834bf263aa1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.169302 Mar 08 13:54:35.568368 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1409/3121] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:35 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:36.584553 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:36.585178 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:36.591751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:36.592201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:36.593255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:36.593691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:36.746401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:36.754177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6e2316a8-7076-419b-8195-f905d074ea27 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.173403 Mar 08 13:54:36.754743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1713/3122] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:36 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:37.771221 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:37.771811 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:37.778160 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:37.778604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:37.779352 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:37.779785 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:37.921084 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:37.928776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b75c3f28-ff0f-424e-9447-0854f0370012 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1758 microversion: 2.1 time: 0.161389 Mar 08 13:54:37.929332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1410/3123] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:37 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:54:38.946119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:54:38.946882 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:54:38.953131 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:38.953581 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:38.954334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:54:38.954762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:54:39.259621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:54:39.267298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-bfc34537-70ee-4dd6-89da-a7d3bbcf3acf tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1761 microversion: 2.1 time: 0.324996 Mar 08 13:54:39.267877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1714/3124] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:54:38 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1761 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:55:11.572835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1209015235"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:55:11.573845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:11.579880 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:11.580381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:11.581213 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:11.581672 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:11.725297 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.network.security_group_api [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Removing security group c6f75071-d40e-4b9b-b23c-23c7a908720e from port c74023ab-27a9-418b-ad7e-3db1b734ce1d Mar 08 13:55:12.160389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-776d82e5-9a45-4344-a7b6-632795f483c1 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/action" status: 202 len: 0 microversion: 2.1 time: 0.591750 Mar 08 13:55:12.165335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1411/3125] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:55:11 2022] POST /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:55:12.176369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-d50862df-e974-4f5b-8748-07cb1cc703fa req-7f4d079d-f872-4f52-96ef-23332ff3e301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939642ef-c94a-4884-bd7d-90a70997c3eb", "tag": "c74023ab-27a9-418b-ad7e-3db1b734ce1d"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:55:12.201673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-d50862df-e974-4f5b-8748-07cb1cc703fa req-7f4d079d-f872-4f52-96ef-23332ff3e301 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:12.202126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-d50862df-e974-4f5b-8748-07cb1cc703fa req-7f4d079d-f872-4f52-96ef-23332ff3e301 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:12.225059 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-d50862df-e974-4f5b-8748-07cb1cc703fa req-7f4d079d-f872-4f52-96ef-23332ff3e301 service nova] Creating event network-changed:c74023ab-27a9-418b-ad7e-3db1b734ce1d for instance 939642ef-c94a-4884-bd7d-90a70997c3eb on hv-cinder-83009 Mar 08 13:55:12.239154 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-d50862df-e974-4f5b-8748-07cb1cc703fa req-7f4d079d-f872-4f52-96ef-23332ff3e301 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066375 Mar 08 13:55:12.239754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1715/3126] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:55:14.040870 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:14.041952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:14.047933 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:14.048381 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:14.049172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:14.049612 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:14.130229 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lazy-loading 'services' on Instance uuid 939642ef-c94a-4884-bd7d-90a70997c3eb {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:55:14.254615 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-2a9aabfa-c2a0-43e5-8082-661e26d81781 req-a533561b-837e-4071-9e3c-f21297ed7818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939642ef-c94a-4884-bd7d-90a70997c3eb", "tag": "c74023ab-27a9-418b-ad7e-3db1b734ce1d"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:55:14.263421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-2a9aabfa-c2a0-43e5-8082-661e26d81781 req-a533561b-837e-4071-9e3c-f21297ed7818 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:14.263868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-2a9aabfa-c2a0-43e5-8082-661e26d81781 req-a533561b-837e-4071-9e3c-f21297ed7818 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:14.274774 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-2a9aabfa-c2a0-43e5-8082-661e26d81781 req-a533561b-837e-4071-9e3c-f21297ed7818 service nova] Creating event network-changed:c74023ab-27a9-418b-ad7e-3db1b734ce1d for instance 939642ef-c94a-4884-bd7d-90a70997c3eb on hv-cinder-83009 Mar 08 13:55:14.279504 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-2a9aabfa-c2a0-43e5-8082-661e26d81781 req-a533561b-837e-4071-9e3c-f21297ed7818 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029433 Mar 08 13:55:14.280089 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1716/3127] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:55:14.438134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f75fbb2b-bf2e-42c3-a01c-9f4861ce0598 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "DELETE /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments/10db924c-a4d3-4be8-b25c-3a6c6a4bfd8e" status: 202 len: 0 microversion: 2.1 time: 0.401563 Mar 08 13:55:14.439179 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1412/3128] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:55:14 2022] DELETE /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments/10db924c-a4d3-4be8-b25c-3a6c6a4bfd8e => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:55:14.448498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f911b3e4-02cf-46d9-9d62-60c1c7cb18f0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:14.449940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f911b3e4-02cf-46d9-9d62-60c1c7cb18f0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:14.456522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f911b3e4-02cf-46d9-9d62-60c1c7cb18f0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:14.457393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f911b3e4-02cf-46d9-9d62-60c1c7cb18f0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:14.458375 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f911b3e4-02cf-46d9-9d62-60c1c7cb18f0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:14.458993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f911b3e4-02cf-46d9-9d62-60c1c7cb18f0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:14.490343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f911b3e4-02cf-46d9-9d62-60c1c7cb18f0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Mar 08 13:55:14.491222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1717/3129] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:55:14 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:55:15.503598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-85064890-a321-4875-ad9f-fa9eeafbbd19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:15.504645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-85064890-a321-4875-ad9f-fa9eeafbbd19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:15.511796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85064890-a321-4875-ad9f-fa9eeafbbd19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:15.515594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85064890-a321-4875-ad9f-fa9eeafbbd19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:15.515594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85064890-a321-4875-ad9f-fa9eeafbbd19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:15.515594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85064890-a321-4875-ad9f-fa9eeafbbd19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:15.540838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-85064890-a321-4875-ad9f-fa9eeafbbd19 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041586 Mar 08 13:55:15.541400 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1413/3130] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:55:15 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 13:55:15.551095 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:15.551636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:15.557777 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:15.558217 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:15.558966 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:15.559397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:15.631206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] HTTP exception thrown: Instance 939642ef-c94a-4884-bd7d-90a70997c3eb is not attached to volume 10db924c-a4d3-4be8-b25c-3a6c6a4bfd8e Mar 08 13:55:15.631206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Returning 404 to user: Instance 939642ef-c94a-4884-bd7d-90a70997c3eb is not attached to volume 10db924c-a4d3-4be8-b25c-3a6c6a4bfd8e {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:55:15.631999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-010613a5-9fd3-43bc-89c4-4d8a78539eb0 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "DELETE /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments/10db924c-a4d3-4be8-b25c-3a6c6a4bfd8e" status: 404 len: 154 microversion: 2.1 time: 0.085030 Mar 08 13:55:15.632535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1718/3131] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:55:15 2022] DELETE /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb/os-volume_attachments/10db924c-a4d3-4be8-b25c-3a6c6a4bfd8e => generated 154 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:55:16.921113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:16.921604 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:16.927784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:16.928265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:16.929067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:16.929511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:16.953424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:55:17.277173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-35cd5bd9-4616-488b-b7b7-df17f1e5311b tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "DELETE /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 204 len: 0 microversion: 2.1 time: 0.359570 Mar 08 13:55:17.277764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1414/3132] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:55:16 2022] DELETE /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:55:17.285931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:17.286570 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:17.293411 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:17.293854 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:17.294613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:17.295048 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:17.428377 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:55:17.436562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7e20f279-0995-4a47-90be-7c4cf4ad24b3 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1555 microversion: 2.1 time: 0.154325 Mar 08 13:55:17.437148 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1719/3133] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:55:17 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:55:18.455018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:18.455718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:18.462066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:18.462511 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:18.463273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:18.463705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:18.596667 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:55:18.604495 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3cac6cc1-f51f-4019-83d6-976a2bc6cd0e tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1555 microversion: 2.1 time: 0.154152 Mar 08 13:55:18.605032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1415/3134] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:55:18 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:55:19.622688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:19.622688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:19.629091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:19.629554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:19.630316 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:19.630750 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:19.634415 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-5b02b9f7-24fd-47f6-ba36-c1a0e5973982 req-5f387209-fdb2-4b5b-8a65-9a08e24c383b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939642ef-c94a-4884-bd7d-90a70997c3eb", "name": "network-vif-deleted", "tag": "c74023ab-27a9-418b-ad7e-3db1b734ce1d"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:55:19.645439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-5b02b9f7-24fd-47f6-ba36-c1a0e5973982 req-5f387209-fdb2-4b5b-8a65-9a08e24c383b service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:19.645439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-5b02b9f7-24fd-47f6-ba36-c1a0e5973982 req-5f387209-fdb2-4b5b-8a65-9a08e24c383b service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:19.655429 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-5b02b9f7-24fd-47f6-ba36-c1a0e5973982 req-5f387209-fdb2-4b5b-8a65-9a08e24c383b service nova] Creating event network-vif-deleted:c74023ab-27a9-418b-ad7e-3db1b734ce1d for instance 939642ef-c94a-4884-bd7d-90a70997c3eb on hv-cinder-83009 Mar 08 13:55:19.660408 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-5b02b9f7-24fd-47f6-ba36-c1a0e5973982 req-5f387209-fdb2-4b5b-8a65-9a08e24c383b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031314 Mar 08 13:55:19.661033 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1416/3135] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 13:55:19.694294 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88b139b7ac7488c9b48216350775c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab8d126a4574df48a127b8c3a03b20d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:55:19.702352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-20523bca-28e1-45a8-8dfd-dd62eeb708ad tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 200 len: 1513 microversion: 2.1 time: 0.084149 Mar 08 13:55:19.702917 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1720/3136] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:55:19 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 1513 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:55:20.720575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:20.721312 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] [instance: 939642ef-c94a-4884-bd7d-90a70997c3eb] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:55:20.728057 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:20.728498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:20.729291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:55:20.729726 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:55:20.742899 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] HTTP exception thrown: Instance 939642ef-c94a-4884-bd7d-90a70997c3eb could not be found. Mar 08 13:55:20.743473 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Returning 404 to user: Instance 939642ef-c94a-4884-bd7d-90a70997c3eb could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:55:20.744319 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1ba415b1-9a28-45a1-bba8-e15a70eb0bda tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb" status: 404 len: 111 microversion: 2.1 time: 0.028691 Mar 08 13:55:20.744867 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1417/3137] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:55:20 2022] GET /compute/v2.1/servers/939642ef-c94a-4884-bd7d-90a70997c3eb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:55:20.752850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1ec3198e-56d3-44ff-9dfa-c5986ae50106 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] Calling method '.version_select at 0x7f5e2d4e5670>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:55:20.872419 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1ec3198e-56d3-44ff-9dfa-c5986ae50106 tempest-TestMinimumBasicScenario-1022086564 tempest-TestMinimumBasicScenario-1022086564-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1453283883" status: 202 len: 0 microversion: 2.1 time: 0.123266 Mar 08 13:55:20.873035 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1721/3138] 10.222.0.52 () {58 vars in 1271 bytes} [Tue Mar 8 13:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1453283883 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:55:35.513637 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:55:35.514245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:55:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:55:46.806988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:55:46.807531 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:56:37.610987 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: ERROR oslo.messaging._drivers.impl_rabbit [-] [775bea68-bb37-4839-a4e0-e7157fb1b3db] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 08 13:56:37.615361 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:37.615884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:37.621790 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:37.622240 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:37.623001 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:37.623433 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:37.637075 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Instance 9a7aeeb2-799d-4194-a169-f60c3c630593 could not be found. Mar 08 13:56:37.637653 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 404 to user: Instance 9a7aeeb2-799d-4194-a169-f60c3c630593 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:37.638466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f6ef652b-bb21-4010-ae9d-f3936bff962e tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 404 len: 111 microversion: 2.20 time: 0.029301 Mar 08 13:56:37.638999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1418/3139] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Mar 8 13:56:37 2022] DELETE /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:56:37.648161 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:37.648795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 9a7aeeb2-799d-4194-a169-f60c3c630593] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:37.655421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:37.655866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:37.656644 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:37.657097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:37.676880 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Instance 9a7aeeb2-799d-4194-a169-f60c3c630593 could not be found. Mar 08 13:56:37.677476 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 404 to user: Instance 9a7aeeb2-799d-4194-a169-f60c3c630593 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:37.678305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4352642a-19b8-43c7-a86e-6cd4394564df tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593" status: 404 len: 111 microversion: 2.20 time: 0.035241 Mar 08 13:56:37.678852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1722/3140] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:56:37 2022] GET /compute/v2.1/servers/9a7aeeb2-799d-4194-a169-f60c3c630593 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:56:38.588698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:38.589456 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:38.595505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.595957 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.596743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.597183 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.613094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 could not be found. Mar 08 13:56:38.613671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:38.614465 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-aa9b8858-27d9-46d6-9a85-41bd53b71402 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 404 len: 111 microversion: 2.1 time: 0.029912 Mar 08 13:56:38.614989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1419/3141] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:56:38 2022] DELETE /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:56:38.623032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:38.623646 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: a602eb3b-374a-47cd-a8e3-ffb9cd421848] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:38.630046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.630498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.631262 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.631703 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.644527 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 could not be found. Mar 08 13:56:38.646831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance a602eb3b-374a-47cd-a8e3-ffb9cd421848 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:38.646831 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-69faec6b-325b-4187-831f-d644753862ac tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848" status: 404 len: 111 microversion: 2.1 time: 0.027609 Mar 08 13:56:38.647539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1723/3142] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:56:38 2022] GET /compute/v2.1/servers/a602eb3b-374a-47cd-a8e3-ffb9cd421848 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:56:38.655947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:38.656450 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:38.663658 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.664103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.664902 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.665335 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.665966 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] [775bea68-bb37-4839-a4e0-e7157fb1b3db] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 36006. Mar 08 13:56:38.679845 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 8f74deff-dd51-47b8-9015-5120e8f0106e could not be found. Mar 08 13:56:38.681223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 8f74deff-dd51-47b8-9015-5120e8f0106e could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:38.681343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-51c4d75e-1160-4054-9fcc-004f19fc5d21 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 404 len: 111 microversion: 2.1 time: 0.029766 Mar 08 13:56:38.682017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1420/3143] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:56:38 2022] DELETE /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 13:56:38.689885 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:38.690518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 8f74deff-dd51-47b8-9015-5120e8f0106e] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:38.697364 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.697812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.698582 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:38.699025 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:38.714688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 8f74deff-dd51-47b8-9015-5120e8f0106e could not be found. Mar 08 13:56:38.715274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 8f74deff-dd51-47b8-9015-5120e8f0106e could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:38.716091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1b679636-1678-4601-ad7b-9937c918ec38 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e" status: 404 len: 111 microversion: 2.1 time: 0.030208 Mar 08 13:56:38.716617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1724/3144] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:56:38 2022] GET /compute/v2.1/servers/8f74deff-dd51-47b8-9015-5120e8f0106e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:56:39.089525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:39.090030 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:39.096059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:39.096508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:39.097356 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:39.097809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:39.111643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 could not be found. Mar 08 13:56:39.112302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 404 to user: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:39.113219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-3eb2611c-948d-4990-929f-a5e56e7da33f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 404 len: 111 microversion: 2.20 time: 0.027787 Mar 08 13:56:39.113918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1421/3145] 10.222.0.52 () {60 vars in 1279 bytes} [Tue Mar 8 13:56:39 2022] DELETE /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:56:39.122421 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:39.123007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] [instance: 2d9aabe1-38e8-4c68-aafc-9a389ce1c127] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:39.129107 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:39.129610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:39.130370 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:39.130805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:39.143993 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] HTTP exception thrown: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 could not be found. Mar 08 13:56:39.144652 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] Returning 404 to user: Instance 2d9aabe1-38e8-4c68-aafc-9a389ce1c127 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:39.146081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-70a5ef22-6f10-43b6-96e5-39885cbc048f tempest-AttachVolumeShelveTestJSON-455188286 tempest-AttachVolumeShelveTestJSON-455188286-project] 10.222.0.52 "GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127" status: 404 len: 111 microversion: 2.20 time: 0.027920 Mar 08 13:56:39.146784 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1725/3146] 10.222.0.52 () {60 vars in 1276 bytes} [Tue Mar 8 13:56:39 2022] GET /compute/v2.1/servers/2d9aabe1-38e8-4c68-aafc-9a389ce1c127 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 13:56:39.994256 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:39.994817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:40.001195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:40.001640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:40.002404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:40.002834 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:40.016474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 701ec119-507b-4b00-b365-bb76f36feab1 could not be found. Mar 08 13:56:40.017161 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 701ec119-507b-4b00-b365-bb76f36feab1 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:40.017996 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0cab01de-b089-4751-a457-f1ea761c9688 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "DELETE /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 404 len: 111 microversion: 2.1 time: 0.027718 Mar 08 13:56:40.018553 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1422/3147] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:56:39 2022] DELETE /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:56:40.027108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:40.027718 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] [instance: 701ec119-507b-4b00-b365-bb76f36feab1] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:40.034004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:40.034461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:40.035228 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:40.036276 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:40.049872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] HTTP exception thrown: Instance 701ec119-507b-4b00-b365-bb76f36feab1 could not be found. Mar 08 13:56:40.050469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] Returning 404 to user: Instance 701ec119-507b-4b00-b365-bb76f36feab1 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:56:40.051898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c680fdd3-25d0-4013-8d2d-be4e83f45736 tempest-AttachVolumeNegativeTest-371630179 tempest-AttachVolumeNegativeTest-371630179-project] 10.222.0.52 "GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1" status: 404 len: 111 microversion: 2.1 time: 0.028029 Mar 08 13:56:40.053051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1726/3148] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:56:40 2022] GET /compute/v2.1/servers/701ec119-507b-4b00-b365-bb76f36feab1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:56:52.039885 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2a82ebda-aa1d-4c3a-9352-22ecf54979a5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'create', calling method: .version_select at 0x7f5e31ec45e0>, body: {"keypair": {"name": "tempest-keypair-415621801"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:56:52.060930 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-2a82ebda-aa1d-4c3a-9352-22ecf54979a5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:56:52.065925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-2a82ebda-aa1d-4c3a-9352-22ecf54979a5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for user 01d34f11504f4ac99ac7487bb4156d2c and project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:56:52.336324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-2a82ebda-aa1d-4c3a-9352-22ecf54979a5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:56:52.340251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-2a82ebda-aa1d-4c3a-9352-22ecf54979a5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for user 01d34f11504f4ac99ac7487bb4156d2c and project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:56:52.354263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2a82ebda-aa1d-4c3a-9352-22ecf54979a5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.556152 Mar 08 13:56:52.354850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1423/3149] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:56:51 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:56:55.242736 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1929686711", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f486c9e5-294f-4f23-8b26-0d9926a65607"}], "security_groups": [{"name": "tempest-securitygroup--558040050"}], "key_name": "tempest-keypair-415621801", "user_data": "}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:56:55.375482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] validate_networks() for [('f486c9e5-294f-4f23-8b26-0d9926a65607', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:56:55.883460 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:56:55.884002 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:56:55.884478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:56:55.884969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:56:55.885386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:56:55.895497 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:55.895999 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:55.896852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:55.897286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:55.914560 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:56:55.918751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for user 01d34f11504f4ac99ac7487bb4156d2c and project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:56:55.930032 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:56:55.932315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:56:56.088872 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a3bb725a-ebd6-4a34-8766-87866ced2ed5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.850009 Mar 08 13:56:56.089514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1727/3150] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:56:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:56:56.100914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-42be860b-9bc3-4958-aca8-be3d3163a95c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:56.101632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-42be860b-9bc3-4958-aca8-be3d3163a95c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:56.333468 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-42be860b-9bc3-4958-aca8-be3d3163a95c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:56:56.341907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-42be860b-9bc3-4958-aca8-be3d3163a95c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1237 microversion: 2.1 time: 0.246114 Mar 08 13:56:56.342472 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1424/3151] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:56:56 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1237 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:56:57.359277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1c446093-de34-4c29-9129-569fa75043db tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:57.359884 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1c446093-de34-4c29-9129-569fa75043db tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:57.411209 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1c446093-de34-4c29-9129-569fa75043db tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:56:57.418315 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1c446093-de34-4c29-9129-569fa75043db tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1237 microversion: 2.1 time: 0.062933 Mar 08 13:56:57.418865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1728/3152] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:56:57 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1237 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:56:58.437583 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:58.438397 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:58.445593 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:58.446041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:58.446918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:58.447359 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:58.508234 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:56:58.515421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9b00024e-4ad3-4336-8b6b-aa6d3ac6dc05 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1289 microversion: 2.1 time: 0.083775 Mar 08 13:56:58.515978 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1425/3153] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:56:58 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:56:59.533317 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:56:59.533924 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:56:59.540961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:59.541410 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:59.542177 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:56:59.542614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:56:59.605907 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:56:59.613322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-33a89499-972b-4f3d-96e9-04d7d7628747 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1295 microversion: 2.1 time: 0.083965 Mar 08 13:56:59.613874 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1729/3154] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:56:59 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:00.631017 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:00.631630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:00.637981 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:00.638424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:00.639219 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:00.639688 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:00.890250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:00.899744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e661fc3f-ef79-4593-bead-e42f0bbe7e0b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1362 microversion: 2.1 time: 0.273113 Mar 08 13:57:00.900369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1426/3155] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:00 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:01.091848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-b45b434e-174e-4d57-b9d5-ad1fb74f8fa4 req-dc442701-ff64-454e-b8be-85bb72003edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75", "tag": "979709fa-deab-4332-82a0-c7dcddc817f7"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:57:01.109679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-b45b434e-174e-4d57-b9d5-ad1fb74f8fa4 req-dc442701-ff64-454e-b8be-85bb72003edc service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:01.110037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-b45b434e-174e-4d57-b9d5-ad1fb74f8fa4 req-dc442701-ff64-454e-b8be-85bb72003edc service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:01.122717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-b45b434e-174e-4d57-b9d5-ad1fb74f8fa4 req-dc442701-ff64-454e-b8be-85bb72003edc service nova] Creating event network-changed:979709fa-deab-4332-82a0-c7dcddc817f7 for instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 on hv-cinder-83009 Mar 08 13:57:01.127998 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-b45b434e-174e-4d57-b9d5-ad1fb74f8fa4 req-dc442701-ff64-454e-b8be-85bb72003edc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040003 Mar 08 13:57:01.128596 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1730/3156] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:57:01.921222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:01.921222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:01.925061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:01.925613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:01.926516 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:01.927263 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:02.068152 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:02.075627 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d72f5857-660c-49f2-a52c-eea77f49747f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1362 microversion: 2.1 time: 0.161656 Mar 08 13:57:02.076196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1427/3157] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:01 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:03.094127 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:03.094751 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:03.101236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:03.101680 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:03.102437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:03.102867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:03.252706 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:03.260459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fcfed91b-b670-4e90-a5c6-907e4038564e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1362 microversion: 2.1 time: 0.171018 Mar 08 13:57:03.261034 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1731/3158] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:03 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:04.279500 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:04.280106 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:04.290236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:04.290568 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:04.291369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:04.291802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:04.431980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:04.439720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-42abe474-1051-4cf8-ba2f-c65dec85d5c1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1362 microversion: 2.1 time: 0.164068 Mar 08 13:57:04.440287 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1428/3159] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:04 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:05.456631 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:05.457259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:05.464599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:05.465088 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:05.465942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:05.466494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:05.604518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:05.611848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b47fa54a-4007-417d-af00-e30df796a11a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1362 microversion: 2.1 time: 0.159020 Mar 08 13:57:05.612402 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1732/3160] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:05 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:06.629982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:06.630771 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:06.636980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:06.642251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:06.642251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:06.642251 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:06.773611 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:06.780764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eed7538a-2113-46cd-898a-d2a04ae3aa33 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1362 microversion: 2.1 time: 0.155085 Mar 08 13:57:06.782949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1429/3161] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:06 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:07.126845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-9eb6f8ee-69aa-4f7e-b1cb-96bb2d23f732 req-8779f04d-ca88-49a0-b83f-3e0adc41d438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75", "name": "network-vif-plugged", "status": "completed", "tag": "979709fa-deab-4332-82a0-c7dcddc817f7"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:57:07.136517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-9eb6f8ee-69aa-4f7e-b1cb-96bb2d23f732 req-8779f04d-ca88-49a0-b83f-3e0adc41d438 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:07.137229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-9eb6f8ee-69aa-4f7e-b1cb-96bb2d23f732 req-8779f04d-ca88-49a0-b83f-3e0adc41d438 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:07.150954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-9eb6f8ee-69aa-4f7e-b1cb-96bb2d23f732 req-8779f04d-ca88-49a0-b83f-3e0adc41d438 service nova] Creating event network-vif-plugged:979709fa-deab-4332-82a0-c7dcddc817f7 for instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 on hv-cinder-83009 Mar 08 13:57:07.156119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-9eb6f8ee-69aa-4f7e-b1cb-96bb2d23f732 req-8779f04d-ca88-49a0-b83f-3e0adc41d438 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155728 Mar 08 13:57:07.161126 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1733/3162] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:57:07.796537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:07.801589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:07.806389 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:07.806947 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:07.807755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:07.808201 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:07.945223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:07.952482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-26206df5-d0d0-46ee-b0e6-a5cf7404f31b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1362 microversion: 2.1 time: 0.159818 Mar 08 13:57:07.953077 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1430/3163] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:07 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:08.971051 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:08.971742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:08.978488 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:08.978939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:08.979729 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:08.980140 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:09.111822 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:09.119951 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-82399b11-15ab-460f-a43f-36c1db51b5c5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1549 microversion: 2.1 time: 0.153526 Mar 08 13:57:09.120514 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1734/3164] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:08 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:57:09.136520 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ad3a5867-f0e3-4851-83e3-c6c3a1ba51a8 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:09.137101 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ad3a5867-f0e3-4851-83e3-c6c3a1ba51a8 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:09.143223 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad3a5867-f0e3-4851-83e3-c6c3a1ba51a8 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:09.143734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad3a5867-f0e3-4851-83e3-c6c3a1ba51a8 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:09.144502 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad3a5867-f0e3-4851-83e3-c6c3a1ba51a8 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:09.144976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ad3a5867-f0e3-4851-83e3-c6c3a1ba51a8 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:09.230898 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ad3a5867-f0e3-4851-83e3-c6c3a1ba51a8 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098343 Mar 08 13:57:09.231515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1431/3165] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Mar 8 13:57:09 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:57:10.278864 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-f79c597f-5720-4c2a-8d4b-ffdb4fb50aec req-c0e36f1f-2c97-44ab-b3cd-43af2725313a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75", "tag": "979709fa-deab-4332-82a0-c7dcddc817f7"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:57:10.287303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-f79c597f-5720-4c2a-8d4b-ffdb4fb50aec req-c0e36f1f-2c97-44ab-b3cd-43af2725313a service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:10.287967 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-f79c597f-5720-4c2a-8d4b-ffdb4fb50aec req-c0e36f1f-2c97-44ab-b3cd-43af2725313a service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:10.300041 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-f79c597f-5720-4c2a-8d4b-ffdb4fb50aec req-c0e36f1f-2c97-44ab-b3cd-43af2725313a service nova] Creating event network-changed:979709fa-deab-4332-82a0-c7dcddc817f7 for instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 on hv-cinder-83009 Mar 08 13:57:10.306397 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-f79c597f-5720-4c2a-8d4b-ffdb4fb50aec req-c0e36f1f-2c97-44ab-b3cd-43af2725313a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031124 Mar 08 13:57:10.307446 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1735/3166] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:57:22.735081 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:57:22.735726 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 13:57:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:57:46.702117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-957bc353-85aa-4580-a635-0e0e3acfc65d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:46.702676 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-957bc353-85aa-4580-a635-0e0e3acfc65d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:46.708768 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-957bc353-85aa-4580-a635-0e0e3acfc65d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:46.709230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-957bc353-85aa-4580-a635-0e0e3acfc65d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:46.710002 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-957bc353-85aa-4580-a635-0e0e3acfc65d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:46.710444 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-957bc353-85aa-4580-a635-0e0e3acfc65d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:46.732505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-957bc353-85aa-4580-a635-0e0e3acfc65d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/ips" status: 200 len: 147 microversion: 2.1 time: 0.035640 Mar 08 13:57:46.733108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1432/3167] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 13:57:46 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:57:50.808829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-149834c5-9dbc-474a-ae4c-7ec75aba0808 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65359f46-e06a-4062-9a6a-3a15aed4c728"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:57:50.809950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-149834c5-9dbc-474a-ae4c-7ec75aba0808 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:50.816756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-149834c5-9dbc-474a-ae4c-7ec75aba0808 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:50.817202 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-149834c5-9dbc-474a-ae4c-7ec75aba0808 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:50.817957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-149834c5-9dbc-474a-ae4c-7ec75aba0808 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:50.818414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-149834c5-9dbc-474a-ae4c-7ec75aba0808 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:51.586117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-149834c5-9dbc-474a-ae4c-7ec75aba0808 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782000 Mar 08 13:57:51.586720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1736/3168] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 13:57:50 2022] POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:57:59.089387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-1e045356-0de6-49dc-bc5d-502f67b5df71 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:57:59.096543 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e045356-0de6-49dc-bc5d-502f67b5df71 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:59.097023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-1e045356-0de6-49dc-bc5d-502f67b5df71 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:59.158455 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-1e045356-0de6-49dc-bc5d-502f67b5df71 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Going to try to stop instance {{(pid=117282) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 13:57:59.372806 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-1e045356-0de6-49dc-bc5d-502f67b5df71 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action" status: 202 len: 0 microversion: 2.1 time: 0.287324 Mar 08 13:57:59.373460 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1433/3169] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:57:59 2022] POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:57:59.384611 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:57:59.385339 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:57:59.391798 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:59.392241 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:59.393044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:57:59.393475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:57:59.530965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:57:59.538908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eb01969a-3e00-4f22-b863-553e69d7c580 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.160950 Mar 08 13:57:59.540376 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1737/3170] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:57:59 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:00.558110 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:00.558808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:00.565068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:00.565536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:00.566419 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:00.566949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:00.703222 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:00.711142 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f93a3106-9d48-4f8d-9cfe-27d3048ffa0c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.157859 Mar 08 13:58:00.712182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1434/3171] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:00 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:01.728078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:01.728739 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:01.735045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:01.735499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:01.736259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:01.736712 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:01.874407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:01.882144 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-48fa06ce-7810-4253-842b-57c7062eb79b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.157924 Mar 08 13:58:01.882692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1738/3172] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:01 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:02.899284 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:02.899974 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:02.906640 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:02.908827 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:02.910489 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:02.910983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:03.046129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:03.054189 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5e1ad60b-1e3c-4a76-bde4-cef6b7c84790 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.158856 Mar 08 13:58:03.054758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1435/3173] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:02 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:04.071817 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:04.072423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:04.078688 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:04.079138 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:04.079898 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:04.080335 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:04.215030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:04.223461 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3ac87ccd-be28-41e6-bb71-f60b06f55b29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.155395 Mar 08 13:58:04.224028 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1739/3174] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:04 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:05.241318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:05.241855 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:05.248236 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:05.248734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:05.280103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:05.280103 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:05.381949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:05.389717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c5e5cbc2-6a52-41bd-9a22-9e310dfa18ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.153048 Mar 08 13:58:05.390296 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1436/3175] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:05 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:06.407266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:06.407868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:06.414588 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:06.420434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:06.420434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:06.420434 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:06.546849 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:06.555382 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7a3af32c-2f24-4a4d-9072-d925862e2f07 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.152059 Mar 08 13:58:06.555934 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1740/3176] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:06 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:07.572639 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:07.573266 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:07.579537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:07.579995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:07.580755 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:07.581187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:07.719045 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:07.727010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-83a1cc20-786a-4731-81fc-aa791d08901b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.158240 Mar 08 13:58:07.727563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1437/3177] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:07 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:08.743057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:08.743658 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:08.749772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:08.750222 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:08.750973 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:08.751405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:08.887809 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:08.896423 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-346b3173-3ec6-4442-ac8c-fcbfb0dc6dc4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.157165 Mar 08 13:58:08.897021 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1741/3178] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:08 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:09.914483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:09.915093 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:09.921289 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:09.921717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:09.922484 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:09.922991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:10.058808 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:10.066664 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6713e732-0b89-4bcf-a46f-23cb8130dc67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1724 microversion: 2.1 time: 0.157139 Mar 08 13:58:10.067217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1438/3179] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:09 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:11.083850 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:11.084491 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:11.091043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:11.091493 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:11.092251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:11.092705 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:11.225058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:11.232749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-843c3107-05e4-451c-b0ec-7aacd2214199 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1701 microversion: 2.1 time: 0.152945 Mar 08 13:58:11.233310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1742/3180] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:11 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:11.249525 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-64616136-630a-4f11-a8bc-a50aca5ae473 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:58:11.256244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-64616136-630a-4f11-a8bc-a50aca5ae473 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:11.256723 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-64616136-630a-4f11-a8bc-a50aca5ae473 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:11.278076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-64616136-630a-4f11-a8bc-a50aca5ae473 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Going to try to start instance {{(pid=117282) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 13:58:11.475521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-64616136-630a-4f11-a8bc-a50aca5ae473 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action" status: 202 len: 0 microversion: 2.1 time: 0.229454 Mar 08 13:58:11.476061 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1439/3181] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:58:11 2022] POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:58:11.484194 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:11.494405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:11.494405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:11.494405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:11.494405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:11.494740 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:11.623722 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:11.631352 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fd24cc2e-b6d4-44e7-b3a7-2bd343f72c18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1710 microversion: 2.1 time: 0.150993 Mar 08 13:58:11.632086 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1743/3182] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:11 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:12.649598 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:12.650339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:12.656689 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:12.657153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:12.657913 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:12.658344 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:13.063766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:13.071616 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4c80ab31-6577-4ab8-ba10-45df49910244 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1710 microversion: 2.1 time: 0.426921 Mar 08 13:58:13.072174 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1440/3183] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:12 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1710 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:14.089248 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:14.089847 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:14.096132 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:14.096578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:14.097369 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:14.097805 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:14.226957 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:14.234628 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-913dcea5-8844-481c-99c3-b2302e1be37e tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1714 microversion: 2.1 time: 0.149448 Mar 08 13:58:14.245819 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1744/3184] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:14 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:47.106144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:47.106817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:47.113708 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:47.114158 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:47.114924 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:47.115373 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:47.193439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lazy-loading 'services' on Instance uuid de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:58:47.397128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fc2ed614-b443-42e9-a9c1-0c163dc069a2 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-volume_attachments/65359f46-e06a-4062-9a6a-3a15aed4c728" status: 202 len: 0 microversion: 2.1 time: 0.294686 Mar 08 13:58:47.398584 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1441/3185] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 13:58:47 2022] DELETE /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-volume_attachments/65359f46-e06a-4062-9a6a-3a15aed4c728 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:58:48.509899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-173fa58a-9028-47e3-a11f-6c2c7cec3e41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:58:48.515673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-173fa58a-9028-47e3-a11f-6c2c7cec3e41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:48.516128 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-173fa58a-9028-47e3-a11f-6c2c7cec3e41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:48.574852 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-173fa58a-9028-47e3-a11f-6c2c7cec3e41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Going to try to stop instance {{(pid=117280) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 13:58:48.816077 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-173fa58a-9028-47e3-a11f-6c2c7cec3e41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action" status: 202 len: 0 microversion: 2.1 time: 0.310631 Mar 08 13:58:48.816679 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1745/3186] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:58:48 2022] POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:58:48.839401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:48.839401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:48.839401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:48.839401 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:48.840156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:48.840156 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:48.981099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:48.988537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5cec1c5e-1461-4d63-ae7c-77cfc91a1811 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.164907 Mar 08 13:58:48.989123 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1442/3187] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:48 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:58:50.006870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:50.008135 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:50.014672 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:50.015117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:50.015865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:50.016295 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:50.150046 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:50.157442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7be5d0a2-ab77-4909-bfff-9a5c2da31286 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.154832 Mar 08 13:58:50.158003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1746/3188] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:50 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:51.177517 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:51.178128 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:51.184420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:51.184908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:51.185678 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:51.186120 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:51.318318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:51.326448 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-29fc5cbd-ecdf-4204-ad49-a7ccfa2c6c41 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.152739 Mar 08 13:58:51.327009 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1443/3189] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:51 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:52.343310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:52.343815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:52.350302 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:52.350742 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:52.351495 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:52.351922 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:52.482691 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:52.489915 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-84f70224-9d47-4d15-aa7f-8f4589909021 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.150550 Mar 08 13:58:52.490483 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1747/3190] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:52 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:53.507018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:53.507619 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:53.514801 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:53.515238 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:53.515989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:53.516422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:53.650311 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:53.657638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e84895a6-f724-459d-8df7-a345b94b0991 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.154702 Mar 08 13:58:53.658187 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1444/3191] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:53 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:54.674830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:54.675430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:54.682026 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:54.682544 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:54.683430 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:54.683863 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:54.815113 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:54.824950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-70990567-77b7-4b97-a4e9-0a020d7ad3ff tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.154023 Mar 08 13:58:54.829324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1748/3192] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:54 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:55.842635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:55.843232 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:55.849420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:55.849863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:55.850618 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:55.851050 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:55.985844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:55.993182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4bd8537b-f8cd-47ef-84c7-fe1cb039f967 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.154117 Mar 08 13:58:55.993748 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1445/3193] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:55 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:57.010562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:57.011169 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:57.017480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:57.017925 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:57.018685 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:57.019119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:57.148958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:57.157052 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-74631c7a-ed71-42e7-b5e3-64a08904f479 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.150825 Mar 08 13:58:57.157617 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1749/3194] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:57 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:58.174471 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:58.174994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:58.181283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:58.181733 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:58.182490 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:58.182925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:58.318512 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:58.326181 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-d715f43d-651c-4b70-a93e-01875aa4bb28 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.155614 Mar 08 13:58:58.326749 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1446/3195] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:58 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:58:59.343636 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:58:59.344167 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:58:59.351371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:59.351788 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:59.352547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:58:59.353004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:58:59.487608 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:58:59.495883 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-82435ee1-0f64-47ae-89b6-a9df38887d85 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1678 microversion: 2.1 time: 0.156187 Mar 08 13:58:59.500327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1750/3196] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:58:59 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:00.512908 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:00.513521 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:00.519866 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:00.520310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:00.521098 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:00.521537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:00.658243 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:00.665792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8892fe89-3254-46e1-9a19-d623ccd7ea14 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1655 microversion: 2.1 time: 0.156913 Mar 08 13:59:00.666387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1447/3197] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:00 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:59:00.682499 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-97c654c1-7ebe-40cf-8448-0004bfdecec6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:59:00.689481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97c654c1-7ebe-40cf-8448-0004bfdecec6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:00.689929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-97c654c1-7ebe-40cf-8448-0004bfdecec6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:00.710772 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-97c654c1-7ebe-40cf-8448-0004bfdecec6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Going to try to start instance {{(pid=117280) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 13:59:00.964372 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-97c654c1-7ebe-40cf-8448-0004bfdecec6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action" status: 202 len: 0 microversion: 2.1 time: 0.285518 Mar 08 13:59:00.965027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1751/3198] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 13:59:00 2022] POST /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:59:00.974777 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:00.975390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:00.981338 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:00.981907 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:00.982692 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:00.983162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:01.118760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:01.126972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-cf0aa8eb-f288-4c5b-8c43-e13dffb82f29 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1664 microversion: 2.1 time: 0.156969 Mar 08 13:59:01.127536 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1448/3199] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:00 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:02.145303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:02.146038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:02.152069 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:02.152524 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:02.154574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:02.155030 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:02.297119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:02.304612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8f22b731-e86c-444b-af79-a2b7d05889f9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1664 microversion: 2.1 time: 0.164076 Mar 08 13:59:02.305200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1752/3200] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:02 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:03.323519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:03.324026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:03.331731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:03.332906 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:03.333671 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:03.334105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:03.471091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:03.479469 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4103c91f-e6b3-4431-9ebe-2fbb19808fa9 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1668 microversion: 2.1 time: 0.159863 Mar 08 13:59:03.480104 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1449/3201] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:03 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:06.814919 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:59:06.815546 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:59:09.290526 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 13:59:09.291173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 13:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 13:59:35.773291 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-051b8157-3d51-42b9-a367-f08c095d31b7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:35.777795 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-051b8157-3d51-42b9-a367-f08c095d31b7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:35.780054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-051b8157-3d51-42b9-a367-f08c095d31b7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:35.781057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-051b8157-3d51-42b9-a367-f08c095d31b7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:35.781834 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-051b8157-3d51-42b9-a367-f08c095d31b7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:35.782277 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-051b8157-3d51-42b9-a367-f08c095d31b7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:35.810010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-051b8157-3d51-42b9-a367-f08c095d31b7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040902 Mar 08 13:59:35.810545 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1753/3202] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 13:59:35 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 13:59:35.866005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:35.866487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:35.872333 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:35.872809 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:35.873564 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:35.873989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:35.897744 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 13:59:36.143487 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6983d8ab-6ffe-418a-827d-5c945394cd67 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 204 len: 0 microversion: 2.1 time: 0.280832 Mar 08 13:59:36.143994 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1450/3203] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 13:59:35 2022] DELETE /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 13:59:36.152227 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:36.153877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:36.160252 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:36.160737 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:36.161496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:36.161932 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:36.290723 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:36.298305 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-cb49a8fd-7474-4a7b-930b-9164a68cca55 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1674 microversion: 2.1 time: 0.150065 Mar 08 13:59:36.298862 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1754/3204] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:36 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:37.315921 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:37.316537 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:37.322874 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:37.323313 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:37.324071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:37.324498 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:37.457404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:37.465048 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-323650a4-7db8-4eb8-b0a7-c19505df2901 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1674 microversion: 2.1 time: 0.153447 Mar 08 13:59:37.465646 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1451/3205] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:37 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:38.482518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:38.483160 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:38.490213 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:38.490673 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:38.491436 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:38.491876 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:38.629118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:38.636350 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d1b7fdd5-bc72-43aa-afa0-bd26cf9e85b3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1674 microversion: 2.1 time: 0.157709 Mar 08 13:59:38.636941 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1755/3206] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:38 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:39.129088 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-09bdbcad-0166-4804-9c2c-f24f25bc5596 req-b0619ac2-b82f-4010-8bc3-6085801a562b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75", "name": "network-vif-deleted", "tag": "979709fa-deab-4332-82a0-c7dcddc817f7"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:59:39.137270 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-09bdbcad-0166-4804-9c2c-f24f25bc5596 req-b0619ac2-b82f-4010-8bc3-6085801a562b service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:39.137995 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-09bdbcad-0166-4804-9c2c-f24f25bc5596 req-b0619ac2-b82f-4010-8bc3-6085801a562b service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:39.165952 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-09bdbcad-0166-4804-9c2c-f24f25bc5596 req-b0619ac2-b82f-4010-8bc3-6085801a562b service nova] Creating event network-vif-deleted:979709fa-deab-4332-82a0-c7dcddc817f7 for instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 on hv-cinder-83009 Mar 08 13:59:39.175291 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-09bdbcad-0166-4804-9c2c-f24f25bc5596 req-b0619ac2-b82f-4010-8bc3-6085801a562b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189559 Mar 08 13:59:39.176056 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1452/3207] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:59:39.653390 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:39.653995 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:39.660463 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:39.666333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:39.666333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:39.666333 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:39.694425 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:39.694891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:39.695412 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lazy-loading 'fault' on Instance uuid de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 13:59:39.861692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:39.869235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ec675175-b4dc-4e2a-a9f9-fbd2ac77b6ee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 200 len: 1327 microversion: 2.1 time: 0.219677 Mar 08 13:59:39.870015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1756/3208] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:39 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 1327 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:40.893188 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:40.893879 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:40.899982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:40.900420 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:40.901207 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:40.901638 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:40.914466 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] HTTP exception thrown: Instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 could not be found. Mar 08 13:59:40.915039 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Returning 404 to user: Instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 13:59:40.915884 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-264582ad-7edd-4033-907a-ef7dfbad4522 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 404 len: 111 microversion: 2.1 time: 0.027966 Mar 08 13:59:40.916403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1453/3209] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:40 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 13:59:40.924911 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-684c7adf-d7e0-4446-a9f6-2bb039d93d21 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '.version_select at 0x7f5e31e32af0>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:41.007210 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-684c7adf-d7e0-4446-a9f6-2bb039d93d21 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-415621801" status: 202 len: 0 microversion: 2.1 time: 0.086296 Mar 08 13:59:41.007829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1757/3210] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Mar 8 13:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-415621801 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 13:59:41.815449 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8b24d7f2-8e38-4fe4-b5d7-a88f90784aea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'create', calling method: .version_select at 0x7f5e2d513550>, body: {"keypair": {"name": "tempest-keypair-727070061"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:59:41.828941 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-8b24d7f2-8e38-4fe4-b5d7-a88f90784aea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:59:41.833428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-8b24d7f2-8e38-4fe4-b5d7-a88f90784aea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for user 01d34f11504f4ac99ac7487bb4156d2c and project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:59:42.325439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-8b24d7f2-8e38-4fe4-b5d7-a88f90784aea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:59:42.329168 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-8b24d7f2-8e38-4fe4-b5d7-a88f90784aea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for user 01d34f11504f4ac99ac7487bb4156d2c and project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'key_pairs'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:59:42.348856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8b24d7f2-8e38-4fe4-b5d7-a88f90784aea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.537271 Mar 08 13:59:42.349451 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1454/3211] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 13:59:41 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:44.804216 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1597499832", "imageRef": "e9709e02-1802-44bf-b1fc-b39f969c689b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f486c9e5-294f-4f23-8b26-0d9926a65607"}], "security_groups": [{"name": "tempest-securitygroup--1339458537"}], "key_name": "tempest-keypair-727070061", "user_data": "}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:59:44.903857 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.network.neutron [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] validate_networks() for [('f486c9e5-294f-4f23-8b26-0d9926a65607', None, None, None, None, None)] {{(pid=117280) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 13:59:45.271443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Flavor limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 13:59:45.271868 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Image limits 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 13:59:45.272346 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Flavor pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 13:59:45.272781 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Image pref 0:0:0 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 13:59:45.273193 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.virt.hardware [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117280) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 13:59:45.281855 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:45.282303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:45.283096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:45.283530 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:45.299285 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 13:59:45.303171 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Getting quotas for user 01d34f11504f4ac99ac7487bb4156d2c and project cbb4eab171284cc0adc3af531cb48c7d. Resources: {'cores', 'instances', 'ram'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 13:59:45.313929 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Going to run 1 instances... {{(pid=117280) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 13:59:45.316639 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e9709e02-1802-44bf-b1fc-b39f969c689b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117280) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 13:59:45.424621 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0c872a78-e0cf-483d-aae6-d56f10bf9b32 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625225 Mar 08 13:59:45.425286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1758/3212] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 13:59:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 13:59:45.435324 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2802c57d-3853-4392-8cdb-f6b133e57988 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:45.435925 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2802c57d-3853-4392-8cdb-f6b133e57988 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:45.492299 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2802c57d-3853-4392-8cdb-f6b133e57988 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:45.498912 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2802c57d-3853-4392-8cdb-f6b133e57988 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1237 microversion: 2.1 time: 0.067622 Mar 08 13:59:45.499545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1455/3213] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:45 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 13:59:46.517407 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:46.518623 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:46.525255 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:46.528771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:46.528771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:46.528771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:46.586354 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:46.593475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5e264fc2-e0e7-44a0-9e75-2a1c0f3b99c7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1241 microversion: 2.1 time: 0.080501 Mar 08 13:59:46.594037 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1759/3214] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:46 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:47.609843 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:47.610960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:47.617563 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:47.618021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:47.618792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:47.619244 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:47.685505 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:47.692719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fc7ecf81-affa-492a-ad9f-b11f3460ea47 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1307 microversion: 2.1 time: 0.086919 Mar 08 13:59:47.693268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1456/3215] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:47 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:48.710699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:48.712432 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:48.719505 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:48.719950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:48.720775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:48.721481 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:48.885498 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:48.893196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-21a4545e-a007-4459-86f4-e14180f83920 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1363 microversion: 2.1 time: 0.186729 Mar 08 13:59:48.893790 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1760/3216] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:48 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:49.493196 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-30f94365-a480-4497-a851-c25b7d4c87cc req-38fac34a-0b95-4a0b-8883-f180250e2c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c", "tag": "3eae1054-3785-4e60-b80e-3515026656ea"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:59:49.502425 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-30f94365-a480-4497-a851-c25b7d4c87cc req-38fac34a-0b95-4a0b-8883-f180250e2c3b service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:49.507343 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-30f94365-a480-4497-a851-c25b7d4c87cc req-38fac34a-0b95-4a0b-8883-f180250e2c3b service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:49.518275 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-30f94365-a480-4497-a851-c25b7d4c87cc req-38fac34a-0b95-4a0b-8883-f180250e2c3b service nova] Creating event network-changed:3eae1054-3785-4e60-b80e-3515026656ea for instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c on hv-cinder-83009 Mar 08 13:59:49.524254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-30f94365-a480-4497-a851-c25b7d4c87cc req-38fac34a-0b95-4a0b-8883-f180250e2c3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034870 Mar 08 13:59:49.525247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1457/3217] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:59:49.911264 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:49.911902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:49.918111 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:49.918562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:49.919322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:49.919771 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:50.052251 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:50.059507 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-0562ef72-c8e4-4472-8877-4b19a7330635 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1363 microversion: 2.1 time: 0.152427 Mar 08 13:59:50.060072 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1761/3218] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:49 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:51.078650 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:51.079340 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:51.086856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:51.087295 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:51.088066 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:51.088491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:51.227076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:51.234204 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-ea15fdd9-98f3-4f97-877a-f0a2ef4bc631 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1363 microversion: 2.1 time: 0.160975 Mar 08 13:59:51.234759 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1458/3219] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:51 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:52.250940 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:52.251482 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:52.257683 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:52.258130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:52.258889 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:52.259324 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:52.395289 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:52.402535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c807ed3b-2004-4475-acb8-5e703aad008a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1363 microversion: 2.1 time: 0.155537 Mar 08 13:59:52.403097 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1762/3220] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:52 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:53.419683 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:53.420294 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:53.427357 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:53.427800 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:53.428554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:53.429070 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:53.564054 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:53.572097 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b58541a6-24de-44aa-bf88-59fa67a8aab1 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1363 microversion: 2.1 time: 0.156159 Mar 08 13:59:53.583171 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1459/3221] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:53 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:53.839031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-2402cd9c-b363-4b30-9802-6fd7d9081738 req-2385d061-b407-4cf9-988d-2cc3a347ca86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c", "name": "network-vif-plugged", "status": "completed", "tag": "3eae1054-3785-4e60-b80e-3515026656ea"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:59:53.847947 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-2402cd9c-b363-4b30-9802-6fd7d9081738 req-2385d061-b407-4cf9-988d-2cc3a347ca86 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:53.848386 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-2402cd9c-b363-4b30-9802-6fd7d9081738 req-2385d061-b407-4cf9-988d-2cc3a347ca86 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:53.858702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-2402cd9c-b363-4b30-9802-6fd7d9081738 req-2385d061-b407-4cf9-988d-2cc3a347ca86 service nova] Creating event network-vif-plugged:3eae1054-3785-4e60-b80e-3515026656ea for instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c on hv-cinder-83009 Mar 08 13:59:53.863793 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-2402cd9c-b363-4b30-9802-6fd7d9081738 req-2385d061-b407-4cf9-988d-2cc3a347ca86 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028459 Mar 08 13:59:53.864368 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1763/3222] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:59:54.589705 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:54.590355 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:54.596625 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:54.597105 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:54.597868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:54.598304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:54.730802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:54.738982 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6aaec917-3803-4ca1-bb39-dfbe99d8390b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1363 microversion: 2.1 time: 0.153210 Mar 08 13:59:54.739548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1460/3223] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:54 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:55.764867 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:55.765558 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:55.772464 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:55.772946 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:55.773714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:55.774151 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:55.907031 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 13:59:55.914319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5a4cbed3-b631-48a7-8ece-e2f2735542ea tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1549 microversion: 2.1 time: 0.154370 Mar 08 13:59:55.914870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1764/3224] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 13:59:55 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 13:59:55.930519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a1dd74e3-a321-463a-a8d3-1ee72dff66d6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 13:59:55.931058 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a1dd74e3-a321-463a-a8d3-1ee72dff66d6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 13:59:55.937307 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1dd74e3-a321-463a-a8d3-1ee72dff66d6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:55.937760 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1dd74e3-a321-463a-a8d3-1ee72dff66d6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:55.938510 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1dd74e3-a321-463a-a8d3-1ee72dff66d6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:55.938939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a1dd74e3-a321-463a-a8d3-1ee72dff66d6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:56.020365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a1dd74e3-a321-463a-a8d3-1ee72dff66d6 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093743 Mar 08 13:59:56.021021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1461/3225] 10.222.0.52 () {58 vars in 1274 bytes} [Tue Mar 8 13:59:55 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 13:59:57.027223 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-6d93ef68-b53f-4318-9d2a-75e6f51ffa62 req-207fb745-1fe3-4ea8-aa1c-c8de182b2260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c", "tag": "3eae1054-3785-4e60-b80e-3515026656ea"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 13:59:57.034096 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-6d93ef68-b53f-4318-9d2a-75e6f51ffa62 req-207fb745-1fe3-4ea8-aa1c-c8de182b2260 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 13:59:57.034535 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-6d93ef68-b53f-4318-9d2a-75e6f51ffa62 req-207fb745-1fe3-4ea8-aa1c-c8de182b2260 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 13:59:57.045049 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-6d93ef68-b53f-4318-9d2a-75e6f51ffa62 req-207fb745-1fe3-4ea8-aa1c-c8de182b2260 service nova] Creating event network-changed:3eae1054-3785-4e60-b80e-3515026656ea for instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c on hv-cinder-83009 Mar 08 13:59:57.050172 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-6d93ef68-b53f-4318-9d2a-75e6f51ffa62 req-207fb745-1fe3-4ea8-aa1c-c8de182b2260 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028542 Mar 08 13:59:57.050654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1765/3226] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 13:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:33.206375 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-56288cc0-ebbe-4b0f-aff0-b40b311b7b18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:33.207220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-56288cc0-ebbe-4b0f-aff0-b40b311b7b18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:33.213882 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56288cc0-ebbe-4b0f-aff0-b40b311b7b18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:33.214327 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56288cc0-ebbe-4b0f-aff0-b40b311b7b18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:33.215083 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56288cc0-ebbe-4b0f-aff0-b40b311b7b18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:33.215576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56288cc0-ebbe-4b0f-aff0-b40b311b7b18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:33.237781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-56288cc0-ebbe-4b0f-aff0-b40b311b7b18 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/ips" status: 200 len: 144 microversion: 2.1 time: 0.035807 Mar 08 14:00:33.238337 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1462/3227] 10.222.0.52 () {58 vars in 1247 bytes} [Tue Mar 8 14:00:33 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:35.009981 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-3cf758e1-d765-4a9c-ae58-b367b05f9a5f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "138e616b-dfe1-4650-a1bc-27501e8e51e1"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:00:35.011821 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-3cf758e1-d765-4a9c-ae58-b367b05f9a5f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:35.017866 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf758e1-d765-4a9c-ae58-b367b05f9a5f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:35.018319 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf758e1-d765-4a9c-ae58-b367b05f9a5f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:35.019082 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf758e1-d765-4a9c-ae58-b367b05f9a5f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:35.019518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-3cf758e1-d765-4a9c-ae58-b367b05f9a5f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:35.774181 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-3cf758e1-d765-4a9c-ae58-b367b05f9a5f tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.768803 Mar 08 14:00:35.774806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1766/3228] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 14:00:35 2022] POST /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments => generated 194 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:43.245750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-77f35855-764f-4ed4-bc25-daf5495f7ac3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:43.246673 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-77f35855-764f-4ed4-bc25-daf5495f7ac3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:43.253366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77f35855-764f-4ed4-bc25-daf5495f7ac3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:43.254645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77f35855-764f-4ed4-bc25-daf5495f7ac3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:43.254645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77f35855-764f-4ed4-bc25-daf5495f7ac3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:43.254876 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-77f35855-764f-4ed4-bc25-daf5495f7ac3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:43.282891 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-77f35855-764f-4ed4-bc25-daf5495f7ac3 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 Mar 08 14:00:43.283351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1463/3229] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 14:00:43 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:43.294015 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6038311e-73cd-4b80-a70b-5b871425049b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:43.294578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6038311e-73cd-4b80-a70b-5b871425049b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:43.301408 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6038311e-73cd-4b80-a70b-5b871425049b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:43.301860 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6038311e-73cd-4b80-a70b-5b871425049b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:43.302624 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6038311e-73cd-4b80-a70b-5b871425049b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:43.303061 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6038311e-73cd-4b80-a70b-5b871425049b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:43.333554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6038311e-73cd-4b80-a70b-5b871425049b tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/138e616b-dfe1-4650-a1bc-27501e8e51e1" status: 200 len: 194 microversion: 2.1 time: 0.044199 Mar 08 14:00:43.334119 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1767/3230] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Mar 8 14:00:43 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/138e616b-dfe1-4650-a1bc-27501e8e51e1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:45.100170 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-56d64cd8-b6f2-4646-924a-44f12773f2d0 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f19b3410-a88d-4cad-b444-7e8c63af4059"}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:00:45.101264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-56d64cd8-b6f2-4646-924a-44f12773f2d0 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:45.107491 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56d64cd8-b6f2-4646-924a-44f12773f2d0 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:45.108572 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56d64cd8-b6f2-4646-924a-44f12773f2d0 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:45.109428 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56d64cd8-b6f2-4646-924a-44f12773f2d0 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:45.109862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-56d64cd8-b6f2-4646-924a-44f12773f2d0 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:45.929175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-56d64cd8-b6f2-4646-924a-44f12773f2d0 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "POST /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831894 Mar 08 14:00:45.929794 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1464/3231] 10.222.0.52 () {60 vars in 1322 bytes} [Tue Mar 8 14:00:45 2022] POST /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:53.424414 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-187ebeed-e7fa-4350-a152-e9bfa0c709f7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:53.425343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-187ebeed-e7fa-4350-a152-e9bfa0c709f7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:53.431565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187ebeed-e7fa-4350-a152-e9bfa0c709f7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:53.432018 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187ebeed-e7fa-4350-a152-e9bfa0c709f7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:53.432829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187ebeed-e7fa-4350-a152-e9bfa0c709f7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:53.433268 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-187ebeed-e7fa-4350-a152-e9bfa0c709f7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:53.461702 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-187ebeed-e7fa-4350-a152-e9bfa0c709f7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041820 Mar 08 14:00:53.462457 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1768/3232] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 14:00:53 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:53.611331 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b4dcdbf4-48f9-4892-927a-6109c5667c65 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:53.611918 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b4dcdbf4-48f9-4892-927a-6109c5667c65 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:53.621528 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4dcdbf4-48f9-4892-927a-6109c5667c65 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:53.621989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4dcdbf4-48f9-4892-927a-6109c5667c65 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:53.622772 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4dcdbf4-48f9-4892-927a-6109c5667c65 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:53.623719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b4dcdbf4-48f9-4892-927a-6109c5667c65 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:53.658011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b4dcdbf4-48f9-4892-927a-6109c5667c65 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/138e616b-dfe1-4650-a1bc-27501e8e51e1" status: 200 len: 194 microversion: 2.1 time: 0.051740 Mar 08 14:00:53.658585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1465/3233] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Mar 8 14:00:53 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/138e616b-dfe1-4650-a1bc-27501e8e51e1 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 14:00:53.668139 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:53.668641 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:53.678794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:53.678794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:53.678794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:53.678794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:53.755848 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lazy-loading 'services' on Instance uuid e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:00:53.969761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-707c9350-da69-43ea-98e3-3886f444aa4a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/138e616b-dfe1-4650-a1bc-27501e8e51e1" status: 202 len: 0 microversion: 2.1 time: 0.305210 Mar 08 14:00:53.970301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1769/3234] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 14:00:53 2022] DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/138e616b-dfe1-4650-a1bc-27501e8e51e1 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:00:55.081724 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fcfc3f69-a52d-44b4-97ad-b4faea4ca24a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:55.082265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-fcfc3f69-a52d-44b4-97ad-b4faea4ca24a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:55.088745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcfc3f69-a52d-44b4-97ad-b4faea4ca24a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:55.089194 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcfc3f69-a52d-44b4-97ad-b4faea4ca24a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:55.089989 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcfc3f69-a52d-44b4-97ad-b4faea4ca24a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:55.090477 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-fcfc3f69-a52d-44b4-97ad-b4faea4ca24a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:55.118613 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fcfc3f69-a52d-44b4-97ad-b4faea4ca24a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/f19b3410-a88d-4cad-b444-7e8c63af4059" status: 200 len: 194 microversion: 2.1 time: 0.042569 Mar 08 14:00:55.119175 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1466/3235] 10.222.0.52 () {58 vars in 1412 bytes} [Tue Mar 8 14:00:55 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/f19b3410-a88d-4cad-b444-7e8c63af4059 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:00:55.130437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:55.131092 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:55.137180 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:55.148259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:55.148259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:55.148259 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:55.216055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lazy-loading 'services' on Instance uuid e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:00:55.563775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-90820896-f18f-4864-a366-57983a0d0849 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/f19b3410-a88d-4cad-b444-7e8c63af4059" status: 202 len: 0 microversion: 2.1 time: 0.437774 Mar 08 14:00:55.564367 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1770/3236] 10.222.0.52 () {58 vars in 1415 bytes} [Tue Mar 8 14:00:55 2022] DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments/f19b3410-a88d-4cad-b444-7e8c63af4059 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:00:56.722094 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7e46bfdf-b8ae-4117-aaff-878541761baa tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:56.727656 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7e46bfdf-b8ae-4117-aaff-878541761baa tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:56.729264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e46bfdf-b8ae-4117-aaff-878541761baa tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:56.729717 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e46bfdf-b8ae-4117-aaff-878541761baa tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:56.730482 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e46bfdf-b8ae-4117-aaff-878541761baa tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:56.730922 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7e46bfdf-b8ae-4117-aaff-878541761baa tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:56.758691 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7e46bfdf-b8ae-4117-aaff-878541761baa tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041023 Mar 08 14:00:56.762021 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1467/3237] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 14:00:56 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 14:00:56.867478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-834da616-84f7-4982-b52e-545a8ce14359 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:56.868475 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-834da616-84f7-4982-b52e-545a8ce14359 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:56.874590 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-834da616-84f7-4982-b52e-545a8ce14359 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:56.875044 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-834da616-84f7-4982-b52e-545a8ce14359 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:56.875806 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-834da616-84f7-4982-b52e-545a8ce14359 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:56.876245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-834da616-84f7-4982-b52e-545a8ce14359 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:56.903547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-834da616-84f7-4982-b52e-545a8ce14359 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040756 Mar 08 14:00:56.904091 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1771/3238] 10.222.0.52 () {58 vars in 1301 bytes} [Tue Mar 8 14:00:56 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 14:00:56.960725 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:56.961239 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:56.967165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:56.968182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:56.969076 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:56.969501 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:56.992126 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:00:57.272182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7a987039-a4ec-40e0-85d7-1d8a07164715 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 204 len: 0 microversion: 2.1 time: 0.315004 Mar 08 14:00:57.272832 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1468/3239] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 14:00:56 2022] DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 14:00:57.281098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:57.281687 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:57.288470 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:57.288955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:57.289720 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:57.290159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:57.422435 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:00:57.429827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e4784467-a626-454f-9100-9f72aa70824d tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1672 microversion: 2.1 time: 0.152847 Mar 08 14:00:57.430388 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1772/3240] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:00:57 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:00:58.448099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:58.448829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:58.455135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:58.458779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:58.458779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:58.458779 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:58.588716 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:00:58.596575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6f6a77ed-aa34-4223-a959-082f0c449e80 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1672 microversion: 2.1 time: 0.152823 Mar 08 14:00:58.597169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1469/3241] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:00:58 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:00:59.616701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:00:59.616701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:00:59.622731 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:59.623260 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:59.624303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:00:59.624773 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:00:59.693700 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:00:59.701115 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-74fb8774-1012-4c50-95ab-61959d3d6fee tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1604 microversion: 2.1 time: 0.089841 Mar 08 14:00:59.702371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1773/3242] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:00:59 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:01:00.166316 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-3a53f124-eae5-4f6b-8454-7a332631bdc7 req-b5b80b2c-e47e-4892-9e9e-4abc5b5ef353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c", "name": "network-vif-deleted", "tag": "3eae1054-3785-4e60-b80e-3515026656ea"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:01:00.175318 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-3a53f124-eae5-4f6b-8454-7a332631bdc7 req-b5b80b2c-e47e-4892-9e9e-4abc5b5ef353 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:00.175677 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-3a53f124-eae5-4f6b-8454-7a332631bdc7 req-b5b80b2c-e47e-4892-9e9e-4abc5b5ef353 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:00.188069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-3a53f124-eae5-4f6b-8454-7a332631bdc7 req-b5b80b2c-e47e-4892-9e9e-4abc5b5ef353 service nova] Creating event network-vif-deleted:3eae1054-3785-4e60-b80e-3515026656ea for instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c on hv-cinder-83009 Mar 08 14:01:00.193761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-3a53f124-eae5-4f6b-8454-7a332631bdc7 req-b5b80b2c-e47e-4892-9e9e-4abc5b5ef353 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030776 Mar 08 14:01:00.194365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1470/3243] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:00.719206 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:00.719810 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:01:00.726083 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:00.726539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:00.727557 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:00.727996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:00.760953 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:00.761343 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:00.761796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lazy-loading 'fault' on Instance uuid e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:01:00.802047 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01d34f11504f4ac99ac7487bb4156d2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb4eab171284cc0adc3af531cb48c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:01:00.809534 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5a29e95b-ff11-4072-ae2e-ef730c5b6442 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 200 len: 1327 microversion: 2.1 time: 0.094437 Mar 08 14:01:00.810108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1774/3244] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:01:00 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:01:01.828053 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:01.828780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:01:01.835576 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:01.836031 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:01.836824 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:01.837264 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:01.850116 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] HTTP exception thrown: Instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c could not be found. Mar 08 14:01:01.850699 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Returning 404 to user: Instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:01:01.851515 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bbe8c415-a4db-4087-a079-92ef3f4d86d5 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 404 len: 111 microversion: 2.1 time: 0.028343 Mar 08 14:01:01.852041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1471/3245] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:01:01 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:01:01.860406 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-baa427c8-ef04-481e-8ef6-525c63f2172c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '.version_select at 0x7f5e31de8940>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:01.941714 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-baa427c8-ef04-481e-8ef6-525c63f2172c tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727070061" status: 202 len: 0 microversion: 2.1 time: 0.085116 Mar 08 14:01:01.942286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1775/3246] 10.222.0.52 () {58 vars in 1217 bytes} [Tue Mar 8 14:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727070061 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:01:05.205620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:05.206117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:01:05.212474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:05.213005 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:05.213715 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:05.214153 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:05.228129 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] HTTP exception thrown: Instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c could not be found. Mar 08 14:01:05.228776 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Returning 404 to user: Instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:01:05.229635 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-dfadf364-a3c8-4897-88d5-8dba1aca3930 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 404 len: 111 microversion: 2.1 time: 0.028430 Mar 08 14:01:05.230374 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1472/3247] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 14:01:05 2022] DELETE /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:01:05.239130 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:05.239744 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:01:05.246163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:05.246613 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:05.247381 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:05.247825 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:05.261246 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] HTTP exception thrown: Instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c could not be found. Mar 08 14:01:05.261842 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Returning 404 to user: Instance e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:01:05.262709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-b13f1ff9-b117-421d-86a4-f834062512a4 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c" status: 404 len: 111 microversion: 2.1 time: 0.027846 Mar 08 14:01:05.263243 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1776/3248] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:01:05 2022] GET /compute/v2.1/servers/e6aaf5a1-8f32-4d5d-8ec9-fd134c9a246c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:01:06.551595 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:06.552091 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:01:06.558351 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:06.558802 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:06.559557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:06.560023 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:06.573534 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] HTTP exception thrown: Instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 could not be found. Mar 08 14:01:06.574095 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Returning 404 to user: Instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:01:06.574900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c0ce5b78-7230-4c5a-854e-392ef891b99a tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "DELETE /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 404 len: 111 microversion: 2.1 time: 0.027184 Mar 08 14:01:06.575421 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1473/3249] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 14:01:06 2022] DELETE /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:01:06.583503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:06.584121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] [instance: de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:01:06.590279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:06.590767 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:06.591526 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:01:06.591961 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:01:06.604988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.wsgi [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] HTTP exception thrown: Instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 could not be found. Mar 08 14:01:06.605576 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] Returning 404 to user: Instance de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 could not be found. {{(pid=117280) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:01:06.606380 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d5258e9c-be9e-4dbc-81cd-be3bc4ef14a7 tempest-AttachVolumeTestJSON-2043133464 tempest-AttachVolumeTestJSON-2043133464-project] 10.222.0.52 "GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75" status: 404 len: 111 microversion: 2.1 time: 0.026959 Mar 08 14:01:06.606891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1777/3250] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:01:06 2022] GET /compute/v2.1/servers/de7c92d3-20f3-44d1-bcf2-92ceaa1cdd75 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 14:01:14.364728 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-6e06cbae-7b0f-4bdb-994d-0a6cac608817 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31fa4940>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:14.411394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-6e06cbae-7b0f-4bdb-994d-0a6cac608817 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/e0dc439c-2ad2-46d6-8340-2b20cac0a36a" status: 200 len: 351 microversion: 2.1 time: 0.050444 Mar 08 14:01:14.411961 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1474/3251] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 14:01:14 2022] GET /compute/v2.1/os-volumes/e0dc439c-2ad2-46d6-8340-2b20cac0a36a => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:16.113829 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-5f28588b-0405-49b2-a49e-6512bead7ec3 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31e42790>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:16.159870 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-5f28588b-0405-49b2-a49e-6512bead7ec3 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/60a27ed1-7edd-4b0c-9347-4e525a097759" status: 200 len: 351 microversion: 2.1 time: 0.049960 Mar 08 14:01:16.160433 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1778/3252] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 14:01:16 2022] GET /compute/v2.1/os-volumes/60a27ed1-7edd-4b0c-9347-4e525a097759 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:18.105540 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-7f64ab81-68c6-4ae9-b10e-faaec58493ff tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31eb31f0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.152440 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-7f64ab81-68c6-4ae9-b10e-faaec58493ff tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/750ec2ed-97d3-43f4-bc58-f27cb667d2ed" status: 200 len: 351 microversion: 2.1 time: 0.051038 Mar 08 14:01:18.153044 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1475/3253] 10.222.0.52 () {58 vars in 1244 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes/750ec2ed-97d3-43f4-bc58-f27cb667d2ed => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:18.164812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8b2829e4-83d9-43d3-8490-9e4df93e2aed tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31de8310>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.244373 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8b2829e4-83d9-43d3-8490-9e4df93e2aed tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.083766 Mar 08 14:01:18.244969 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1779/3254] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:01:18.256738 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2e24ce44-3922-4c0f-9331-1b36188eaacb tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e2d3c1160>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.335261 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2e24ce44-3922-4c0f-9331-1b36188eaacb tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082164 Mar 08 14:01:18.335817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1476/3255] 10.222.0.52 () {58 vars in 1148 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:18.347908 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-160594f0-2918-41a7-aaa5-bda92e20797b tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31de8d30>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.428586 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-160594f0-2918-41a7-aaa5-bda92e20797b tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084354 Mar 08 14:01:18.429282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1780/3256] 10.222.0.52 () {58 vars in 1133 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:01:18.440435 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-fc8aa4b3-a0bd-4c64-8450-bd57a93dd0a5 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31ec48b0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.520959 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-fc8aa4b3-a0bd-4c64-8450-bd57a93dd0a5 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084300 Mar 08 14:01:18.521554 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1477/3257] 10.222.0.52 () {58 vars in 1166 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:18.533755 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-784b44af-285c-42d0-acd5-62f03100725b tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e2d5e1c10>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.612101 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-784b44af-285c-42d0-acd5-62f03100725b tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082904 Mar 08 14:01:18.612692 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1781/3258] 10.222.0.52 () {58 vars in 1169 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:18.624437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bd2af823-2dfd-40af-a606-e11177bcac50 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31eb29d0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.705585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bd2af823-2dfd-40af-a606-e11177bcac50 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084652 Mar 08 14:01:18.706144 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1478/3259] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:01:18.717117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8f420a27-62f3-4f30-b2c7-641d55532eae tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e31faa4c0>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.796322 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8f420a27-62f3-4f30-b2c7-641d55532eae tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082872 Mar 08 14:01:18.796927 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1782/3260] 10.222.0.52 () {58 vars in 1187 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:01:18.808702 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-bcb61cc7-7da8-4762-b67b-e11a28c79855 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] Calling method '.version_select at 0x7f5e2d38b4c0>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:01:18.886841 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-bcb61cc7-7da8-4762-b67b-e11a28c79855 tempest-VolumesTestJSON-1626391585 tempest-VolumesTestJSON-1626391585-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.081857 Mar 08 14:01:18.887431 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1479/3261] 10.222.0.52 () {58 vars in 1154 bytes} [Tue Mar 8 14:01:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:02:26.823452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:02:26.824071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 14:02:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:02:29.299112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:02:29.299718 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 14:02:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:02:41.040353 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-ac57999e-52b9-4457-8d8e-2629b8c9bbeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Action: 'create', calling method: .version_select at 0x7f5e2d50b670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1877359331"}} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:02:41.053899 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ac57999e-52b9-4457-8d8e-2629b8c9bbeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Getting quotas for project 0e2b64e03b8c4c5ba1501eb1594b623c. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:02:41.057653 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ac57999e-52b9-4457-8d8e-2629b8c9bbeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Getting quotas for user a82d20d6d26448918d2ecf82e8545c19 and project 0e2b64e03b8c4c5ba1501eb1594b623c. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:02:41.252595 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ac57999e-52b9-4457-8d8e-2629b8c9bbeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Getting quotas for project 0e2b64e03b8c4c5ba1501eb1594b623c. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:02:41.256676 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.quota [None req-ac57999e-52b9-4457-8d8e-2629b8c9bbeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Getting quotas for user a82d20d6d26448918d2ecf82e8545c19 and project 0e2b64e03b8c4c5ba1501eb1594b623c. Resources: {'key_pairs'} {{(pid=117280) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:02:41.271060 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-ac57999e-52b9-4457-8d8e-2629b8c9bbeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.400197 Mar 08 14:02:41.271670 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1783/3262] 10.222.0.52 () {60 vars in 1157 bytes} [Tue Mar 8 14:02:40 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:02:59.833762 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: ERROR oslo.messaging._drivers.impl_rabbit [-] [775bea68-bb37-4839-a4e0-e7157fb1b3db] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 08 14:02:59.837781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2033975536", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1877359331", "security_groups": [{"name": "tempest-secgroup-smoke-384003326"}], "networks": [{"uuid": "dd2e0aa7-d827-48a4-b92c-3c4543aaf016"}], "block_device_mapping_v2": [{"uuid": "ed343f3f-1a07-4955-ae32-4541fc2019fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:03:00.040523 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.network.neutron [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] validate_networks() for [('dd2e0aa7-d827-48a4-b92c-3c4543aaf016', None, None, None, None, None)] {{(pid=117282) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 14:03:00.485858 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Flavor limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 14:03:00.486310 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Image limits 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 14:03:00.486780 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Flavor pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 14:03:00.487182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Image pref 0:0:0 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 14:03:00.487585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.virt.hardware [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117282) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 14:03:00.496492 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:00.496977 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:00.497777 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:00.498208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:00.514734 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Getting quotas for project 0e2b64e03b8c4c5ba1501eb1594b623c. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 14:03:00.518751 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.quota [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Getting quotas for user a82d20d6d26448918d2ecf82e8545c19 and project 0e2b64e03b8c4c5ba1501eb1594b623c. Resources: {'cores', 'instances', 'ram'} {{(pid=117282) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 14:03:00.574016 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Going to run 1 instances... {{(pid=117282) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 14:03:00.576059 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed343f3f-1a07-4955-ae32-4541fc2019fb',volume_size=None,volume_type=None)] {{(pid=117282) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 14:03:00.841804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] [775bea68-bb37-4839-a4e0-e7157fb1b3db] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38086. Mar 08 14:03:01.146024 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b09614e0-1b17-4555-8ff6-62978ba3998e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.313838 Mar 08 14:03:01.146838 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1480/3263] 10.222.0.52 () {60 vars in 1146 bytes} [Tue Mar 8 14:02:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 14:03:01.158058 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-54941825-2808-4e11-90d8-1aaec3eaa129 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:01.159393 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-54941825-2808-4e11-90d8-1aaec3eaa129 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:01.214837 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-54941825-2808-4e11-90d8-1aaec3eaa129 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:01.221931 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-54941825-2808-4e11-90d8-1aaec3eaa129 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1089 microversion: 2.1 time: 0.067953 Mar 08 14:03:01.222496 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1784/3264] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:01 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:02.239945 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a335e74d-e04a-4a22-8c3d-d3a44dae4bd3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:02.240558 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a335e74d-e04a-4a22-8c3d-d3a44dae4bd3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:02.291026 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a335e74d-e04a-4a22-8c3d-d3a44dae4bd3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:02.297557 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a335e74d-e04a-4a22-8c3d-d3a44dae4bd3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1089 microversion: 2.1 time: 0.062702 Mar 08 14:03:02.298108 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1481/3265] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:02 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1089 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:03.313741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:03.314540 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:03.321794 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:03.322242 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:03.323012 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:03.323445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:03.386449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:03.393881 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d287e2eb-e8a7-4e1c-b72a-849c4ca5fb1c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1187 microversion: 2.1 time: 0.083957 Mar 08 14:03:03.394437 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1785/3266] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:03 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:04.412143 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:04.412863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:04.420192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:04.421011 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:04.421791 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:04.422224 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:04.638260 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:04.646304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-032abab1-c8a4-420c-8e04-898e8a30c10b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1272 microversion: 2.1 time: 0.239196 Mar 08 14:03:04.646988 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1482/3267] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:04 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:05.363983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-62893743-66cb-4746-bd69-4d7b699a33c4 req-5393f31c-6d06-4f61-bb54-92d3c5269c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e0ada3-d209-4230-bc42-c52d5e5ed37f", "tag": "3e589a1d-1176-451a-9700-884f71bb577b"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:03:05.372503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-62893743-66cb-4746-bd69-4d7b699a33c4 req-5393f31c-6d06-4f61-bb54-92d3c5269c39 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:05.372988 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-62893743-66cb-4746-bd69-4d7b699a33c4 req-5393f31c-6d06-4f61-bb54-92d3c5269c39 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:05.384299 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-62893743-66cb-4746-bd69-4d7b699a33c4 req-5393f31c-6d06-4f61-bb54-92d3c5269c39 service nova] Creating event network-changed:3e589a1d-1176-451a-9700-884f71bb577b for instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f on hv-cinder-83009 Mar 08 14:03:05.389547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-62893743-66cb-4746-bd69-4d7b699a33c4 req-5393f31c-6d06-4f61-bb54-92d3c5269c39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Mar 08 14:03:05.390500 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1786/3268] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:03:05.663545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:05.664784 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:05.671272 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:05.671804 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:05.672580 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:05.673205 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:05.909161 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:05.916620 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-4f894fcb-1a69-4cd2-855d-ac1d91839f60 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.257119 Mar 08 14:03:05.917166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1483/3269] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:05 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:06.934614 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:06.935304 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:06.942043 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:06.942485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:06.943235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:06.943664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:07.074746 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:07.082157 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7a666f6d-ec7e-4a9a-8647-20be07c110ce tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.152167 Mar 08 14:03:07.082716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1787/3270] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:06 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:08.099217 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:08.099856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:08.106350 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:08.106805 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:08.107565 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:08.108003 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:08.242548 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:08.250781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-18ea587d-9adf-436f-8148-efcab47f94b9 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.155410 Mar 08 14:03:08.251644 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1484/3271] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:08 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:09.270286 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:09.270896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:09.277118 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:09.277565 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:09.278323 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:09.278761 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:09.414229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:09.421443 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-eeb671a7-5bdf-41b8-b761-d4e7d8fb2294 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.155416 Mar 08 14:03:09.421996 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1788/3272] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:09 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:10.439015 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:10.439647 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:10.446043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:10.446493 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:10.447250 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:10.447680 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:10.579714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:10.587068 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-f72f0f2f-0bbf-49bf-86ce-0192dc91479e tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.151945 Mar 08 14:03:10.587632 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1485/3273] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:10 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:11.604828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:11.605378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:11.612027 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:11.612467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:11.613240 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:11.613674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:11.745675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:11.753547 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-18c8e4e3-71c7-47cb-aaee-d2906c53fd23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.152664 Mar 08 14:03:11.754117 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1789/3274] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:11 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:12.770951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:12.771566 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:12.777817 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:12.778273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:12.779038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:12.779479 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:12.924038 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:12.929754 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-0e5fdc00-3a9d-4cf8-9b78-509b62c24fe2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.163401 Mar 08 14:03:12.930325 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1486/3275] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:12 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:13.946159 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:13.946803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:13.953303 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:13.953754 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:13.954518 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:13.955444 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:14.086716 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:14.094399 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-258aebc0-93b1-48c3-b3d3-4f8e1a0c5607 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.152164 Mar 08 14:03:14.095232 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1790/3276] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:13 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:14.951394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-1b80bb11-dddb-4dc7-a7a6-d24c8f2ed480 req-3b1a1ad0-cf79-4890-901b-1f7fae2ff904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e0ada3-d209-4230-bc42-c52d5e5ed37f", "name": "network-vif-plugged", "status": "completed", "tag": "3e589a1d-1176-451a-9700-884f71bb577b"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:03:14.959424 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-1b80bb11-dddb-4dc7-a7a6-d24c8f2ed480 req-3b1a1ad0-cf79-4890-901b-1f7fae2ff904 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:14.959862 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-1b80bb11-dddb-4dc7-a7a6-d24c8f2ed480 req-3b1a1ad0-cf79-4890-901b-1f7fae2ff904 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:14.970850 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-1b80bb11-dddb-4dc7-a7a6-d24c8f2ed480 req-3b1a1ad0-cf79-4890-901b-1f7fae2ff904 service nova] Creating event network-vif-plugged:3e589a1d-1176-451a-9700-884f71bb577b for instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f on hv-cinder-83009 Mar 08 14:03:14.974258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: ERROR oslo.messaging._drivers.impl_rabbit [req-1b80bb11-dddb-4dc7-a7a6-d24c8f2ed480 req-3b1a1ad0-cf79-4890-901b-1f7fae2ff904 service nova] [fe08bee0-7368-468b-9d2c-46219ecb956a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 14:03:15.112422 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:15.119283 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:15.119654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:15.120112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:15.120902 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:15.121336 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:15.259678 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:15.266827 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-58bbde01-852d-447e-80f9-23bcaa4a84f2 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.159259 Mar 08 14:03:15.268098 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1791/3277] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:15 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:03:15.981462 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [req-1b80bb11-dddb-4dc7-a7a6-d24c8f2ed480 req-3b1a1ad0-cf79-4890-901b-1f7fae2ff904 service nova] [fe08bee0-7368-468b-9d2c-46219ecb956a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38134. Mar 08 14:03:15.984731 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-1b80bb11-dddb-4dc7-a7a6-d24c8f2ed480 req-3b1a1ad0-cf79-4890-901b-1f7fae2ff904 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.134241 Mar 08 14:03:15.985332 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1487/3278] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:03:16.284747 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:16.285274 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:16.292813 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:16.293281 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:16.294036 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:16.294469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:16.433930 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:16.441201 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9ec5ed5f-b7ac-4086-ba82-2aca5fb6567b tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.160691 Mar 08 14:03:16.441770 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1792/3279] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:16 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:17.459437 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:17.460135 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:17.466321 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:17.466773 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:17.467539 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:17.467976 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:17.609035 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:17.617113 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8598b5e3-6a56-4f94-866c-5db62586edeb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1260 microversion: 2.1 time: 0.162857 Mar 08 14:03:17.617868 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1488/3280] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:17 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:18.634741 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:18.635267 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:18.641525 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:18.641997 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:18.642775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:18.643203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:18.777536 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:18.786147 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-13a01d1b-e7dc-4b84-b311-dfe5caff34a0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1443 microversion: 2.1 time: 0.155350 Mar 08 14:03:18.786717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1793/3281] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:18 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:18.802750 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:03:18.803363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:03:18.809775 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:18.810230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:18.810998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:18.811446 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:18.947365 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:03:18.955442 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e292e537-7376-49b3-88cb-6d73d0e43e5f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1443 microversion: 2.1 time: 0.157308 Mar 08 14:03:18.955999 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1489/3282] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:03:18 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:03:21.335484 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-2e9d48a9-13a9-48dd-8643-f35cc2ecfe0f req-09debc03-a1a6-4fc6-a076-e5f2ffbef68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e0ada3-d209-4230-bc42-c52d5e5ed37f", "tag": "3e589a1d-1176-451a-9700-884f71bb577b"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:03:21.343699 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-2e9d48a9-13a9-48dd-8643-f35cc2ecfe0f req-09debc03-a1a6-4fc6-a076-e5f2ffbef68d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:03:21.344149 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-2e9d48a9-13a9-48dd-8643-f35cc2ecfe0f req-09debc03-a1a6-4fc6-a076-e5f2ffbef68d service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:03:21.355235 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-2e9d48a9-13a9-48dd-8643-f35cc2ecfe0f req-09debc03-a1a6-4fc6-a076-e5f2ffbef68d service nova] Creating event network-changed:3e589a1d-1176-451a-9700-884f71bb577b for instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f on hv-cinder-83009 Mar 08 14:03:21.360116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-2e9d48a9-13a9-48dd-8643-f35cc2ecfe0f req-09debc03-a1a6-4fc6-a076-e5f2ffbef68d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028224 Mar 08 14:03:21.361236 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1794/3283] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:05:16.718916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:05:16.719506 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:16.725552 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:16.726007 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:16.726761 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:16.727208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:16.749847 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.objects.instance [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lazy-loading 'flavor' on Instance uuid 73e0ada3-d209-4230-bc42-c52d5e5ed37f {{(pid=117282) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:05:17.020842 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-642aa171-647e-4ff6-8a36-a7f52f420ef0 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "POST /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f/action" status: 202 len: 0 microversion: 2.1 time: 0.306459 Mar 08 14:05:17.021339 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1490/3284] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 14:05:16 2022] POST /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:05:17.028449 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8442e56-85dc-446a-b985-30a97008016e] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 14:05:17.033494 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:17.034188 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:17.040279 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:17.040749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:17.041517 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:17.041954 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:17.269164 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:17.276503 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d9eb1abe-bb99-4fc4-b04d-b23c67a1c608 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.250474 Mar 08 14:05:17.277045 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1795/3285] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:17 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:18.295273 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:18.295960 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:18.302069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:18.302574 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:18.303330 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:18.303759 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:18.440043 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:18.447643 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-eeb2ceea-b044-4285-9a27-9ed286041463 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.157890 Mar 08 14:05:18.451090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1491/3286] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:18 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:19.466371 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:19.467004 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:19.474610 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:19.475053 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:19.475815 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:19.476247 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:19.491717 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8442e56-85dc-446a-b985-30a97008016e] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38186. Mar 08 14:05:19.614958 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:19.622465 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-6046ce8c-8781-4a32-b473-3f433c270e76 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.160748 Mar 08 14:05:19.624000 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1796/3287] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:19 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:20.639856 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:20.640408 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:20.646631 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:20.647072 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:20.647822 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:20.648258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:20.785810 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:20.793268 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-25a33347-856b-49f0-b4f8-4e15dbd9e05f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.157317 Mar 08 14:05:20.793883 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1492/3288] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:20 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:05:21.810226 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:21.810830 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:21.817125 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:21.817725 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:21.818485 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:21.818916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:21.957916 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:21.965245 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7dce9d89-24ef-49c7-9f83-8a715a272280 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.158951 Mar 08 14:05:21.965808 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1797/3289] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:21 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:05:22.981826 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:22.982532 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:22.988911 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:22.989366 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:22.990136 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:22.990573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:23.135594 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:23.143404 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9741d8eb-144b-4502-8ddf-b184fae09cb6 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.165440 Mar 08 14:05:23.143972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1493/3290] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:22 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:24.160578 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:24.161221 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:24.167469 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:24.168577 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:24.169361 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:24.169791 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:24.301734 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:24.309374 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-c7b27c69-4938-43b8-ba68-21aacd35d816 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.152646 Mar 08 14:05:24.309942 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1798/3291] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:24 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:25.326569 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:25.327173 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:25.333422 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:25.333860 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:25.334623 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:25.335052 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:25.471121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:25.478519 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-5d543f11-4123-4060-899d-47b2ba150914 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.156506 Mar 08 14:05:25.479071 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1494/3292] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:25 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:26.496591 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:26.497266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:26.503522 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:26.503975 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:26.504775 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:26.505215 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:26.640709 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:26.647921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-88b2aba2-130f-41f2-9acc-cfbe4a1de2a7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.155952 Mar 08 14:05:26.648478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1799/3293] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:26 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:27.665746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:27.666262 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:27.673452 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:27.673900 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:27.674872 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:27.675304 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:27.911709 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:27.919681 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-32b3c953-1824-42ee-a3c9-7bfd05359e23 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.257772 Mar 08 14:05:27.920192 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1495/3294] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:27 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:28.938145 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:28.938756 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:28.945112 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:28.945569 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:28.946599 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:28.947038 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:29.078205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:29.085420 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-01d036d7-03b2-44a9-96d3-5d7780777191 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.151083 Mar 08 14:05:29.086009 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1800/3295] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:28 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:05:30.102968 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:30.103575 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:30.110394 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:30.110894 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:30.111662 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:30.112099 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:30.246698 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:30.254247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-009ac3ba-a910-4ac7-a878-9bf57b261c92 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.155145 Mar 08 14:05:30.254814 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1496/3296] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:30 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:31.271055 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:31.271655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:31.277828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:31.278273 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:31.279017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:31.279448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:31.429200 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:31.437108 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-2956064c-26b7-4977-baf3-b02b45aa901c tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1509 microversion: 2.1 time: 0.169838 Mar 08 14:05:31.437674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1801/3297] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:31 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:31.453589 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:05:31.454165 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:31.459983 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:31.460439 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:31.461230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:31.461666 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:31.737461 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [128fb91c-ea65-472b-8bfe-1bb01032bec0] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 14:05:32.744541 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [128fb91c-ea65-472b-8bfe-1bb01032bec0] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 38220. Mar 08 14:05:32.748682 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a9bbbb5b-f8e3-4c28-9027-db28a5d1b727 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "POST /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f/action" status: 202 len: 0 microversion: 2.1 time: 1.299118 Mar 08 14:05:32.749302 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1497/3298] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Mar 8 14:05:31 2022] POST /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f/action => generated 0 bytes in 1300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:05:32.757224 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:32.757828 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:32.765020 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:32.765467 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:32.766218 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:32.766651 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:32.906066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:32.913405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-4533c1b0-9ff5-4f88-b32b-f38b42bfb2f3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1517 microversion: 2.1 time: 0.159956 Mar 08 14:05:32.913964 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1802/3299] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:32 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:33.490729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-dd9fa276-7ad9-4138-8328-a272ae12bea1 req-6829ad4c-615c-4568-a181-5accfe601a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e0ada3-d209-4230-bc42-c52d5e5ed37f", "name": "network-vif-unplugged", "status": "completed", "tag": "3e589a1d-1176-451a-9700-884f71bb577b"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:05:33.499674 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-dd9fa276-7ad9-4138-8328-a272ae12bea1 req-6829ad4c-615c-4568-a181-5accfe601a47 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:33.500117 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-dd9fa276-7ad9-4138-8328-a272ae12bea1 req-6829ad4c-615c-4568-a181-5accfe601a47 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:33.510037 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.compute.server_external_events [req-dd9fa276-7ad9-4138-8328-a272ae12bea1 req-6829ad4c-615c-4568-a181-5accfe601a47 service nova] Unable to find a host for instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f. Dropping event network-vif-unplugged {{(pid=117282) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 14:05:33.510949 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-dd9fa276-7ad9-4138-8328-a272ae12bea1 req-6829ad4c-615c-4568-a181-5accfe601a47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024513 Mar 08 14:05:33.511729 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1498/3300] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 08 14:05:33.931120 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:33.931743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:33.938845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:33.939298 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:33.940066 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:33.940509 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:34.077185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:34.084478 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1501ef51-ef4f-4fae-bc05-ef53ed66adbb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1517 microversion: 2.1 time: 0.157227 Mar 08 14:05:34.085054 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1803/3301] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:33 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:35.102166 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:35.102781 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:35.109764 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:35.110208 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:35.110956 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:35.111387 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:35.241835 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:35.249655 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-60359bb8-2c43-41fa-9655-ffd835755fcb tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1517 microversion: 2.1 time: 0.151413 Mar 08 14:05:35.250216 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1499/3302] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:35 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:35.528812 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:05:35.529321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 14:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:05:36.267266 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:36.267878 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:36.274205 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:36.274650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:36.275405 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:36.275839 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:36.407612 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:36.415104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-fd01683b-9466-4168-b86f-e83764df77fc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1517 microversion: 2.1 time: 0.151707 Mar 08 14:05:36.415655 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1804/3303] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:36 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:37.431253 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:37.431893 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:37.438267 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:37.438714 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:37.439470 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:37.439905 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:37.577247 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:37.584399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-568569bb-2ba2-4229-8103-1543612d6162 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1517 microversion: 2.1 time: 0.157066 Mar 08 14:05:37.585019 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1500/3304] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:37 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:38.602562 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:38.603104 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:38.610116 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:38.610564 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:38.611327 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:38.611762 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:38.751017 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:38.758442 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-d4408de2-f933-4110-8c73-dd7544a5ea5d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1519 microversion: 2.1 time: 0.159753 Mar 08 14:05:38.759675 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1805/3305] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:38 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:39.775406 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:39.776169 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:39.782645 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:39.783090 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:39.783851 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:39.784283 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:39.996112 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:40.003732 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-2facd328-7ee1-443c-901f-6ccf97ae6442 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.232202 Mar 08 14:05:40.004305 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1501/3306] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:39 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:41.020650 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:41.021282 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:41.028401 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:41.028886 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:41.029642 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:41.030078 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:41.170764 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:41.178630 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-7ff4ba5b-7f35-447b-847b-9ec9fb3097d7 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.161730 Mar 08 14:05:41.179355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1806/3307] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:41 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:42.196245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:42.196903 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:42.203220 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:42.203649 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:42.204399 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:42.204865 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:42.340252 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:42.347621 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-a5b9085f-38cb-4763-a2f5-a2187c1998e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.155465 Mar 08 14:05:42.348720 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1502/3308] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:42 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:42.748674 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:05:42.749207 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 14:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:05:43.365713 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:43.366320 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:43.373310 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:43.373759 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:43.374554 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:43.374994 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:43.507057 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:43.514456 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-78bd3822-0cbf-4008-b1eb-194b053bc1bf tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.152741 Mar 08 14:05:43.515007 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1807/3309] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:43 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:44.531797 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:44.532403 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:44.538745 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:44.539193 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:44.539939 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:44.540369 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:44.671497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:44.678916 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-97a00d0b-472c-4112-8358-28002f89ca73 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.150973 Mar 08 14:05:44.679474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1503/3310] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:44 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:05:45.696955 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:45.697539 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:45.704337 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:45.704818 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:45.705574 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:45.706001 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:45.841571 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:45.848877 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-9a9e1046-f081-4a60-9a2e-90461cf1b882 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.155977 Mar 08 14:05:45.849448 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1808/3311] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:45 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:46.866087 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:46.866690 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:46.873624 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:46.874069 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:46.874829 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:46.875258 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:47.010844 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:47.018326 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-b802514a-5f2a-4e95-bc79-250871a356cc tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.156072 Mar 08 14:05:47.018886 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1504/3312] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:46 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:48.035192 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:48.035803 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:48.042711 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:48.043163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:48.043956 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:48.044395 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:48.178950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:48.187094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-670b0629-7471-4379-b6d7-29e7429ca175 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.155746 Mar 08 14:05:48.187654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1809/3313] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:48 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:49.204878 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:49.205483 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:49.211735 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:49.212182 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:49.212972 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:49.213497 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:49.309032 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:05:49.309195 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 14:05:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f (ip 10.222.0.52) !!! Mar 08 14:05:49.344561 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:49.351980 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-85dd271e-a513-440e-8561-76ff086e7c42 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.150930 Mar 08 14:05:49.352538 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1505/3314] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:49 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:50.370743 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:50.371355 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:50.377334 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:50.377786 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:50.378541 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:50.378983 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:50.527431 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:50.535394 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-a0888cd5-e31a-491a-9ce3-1c6547328915 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.169090 Mar 08 14:05:50.535959 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1810/3315] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:50 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:51.534668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [req-a0e51938-8372-4b38-a1ff-7f8939fc7cb4 req-6903b805-ea39-49b8-ab0e-bfe54351ace5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e0ada3-d209-4230-bc42-c52d5e5ed37f", "name": "network-vif-plugged", "status": "completed", "tag": "3e589a1d-1176-451a-9700-884f71bb577b"}]} {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:05:51.542770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-a0e51938-8372-4b38-a1ff-7f8939fc7cb4 req-6903b805-ea39-49b8-ab0e-bfe54351ace5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:51.543210 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [req-a0e51938-8372-4b38-a1ff-7f8939fc7cb4 req-6903b805-ea39-49b8-ab0e-bfe54351ace5 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:51.551865 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:51.557387 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:51.557668 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.compute.server_external_events [req-a0e51938-8372-4b38-a1ff-7f8939fc7cb4 req-6903b805-ea39-49b8-ab0e-bfe54351ace5 service nova] Creating event network-vif-plugged:3e589a1d-1176-451a-9700-884f71bb577b for instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f on hv-cinder-83009 Mar 08 14:05:51.560172 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [req-a0e51938-8372-4b38-a1ff-7f8939fc7cb4 req-6903b805-ea39-49b8-ab0e-bfe54351ace5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029160 Mar 08 14:05:51.560912 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:51.561018 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1506/3316] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:05:51.561362 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:51.562196 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:51.562701 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:51.702976 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:51.710378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-1cb7d0fd-26c6-4386-b87a-3d56aebb77e3 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.162256 Mar 08 14:05:51.710939 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1811/3317] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:51 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:05:52.728254 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:52.729121 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:52.735345 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:52.735792 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:52.736547 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:52.737040 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:52.881363 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:52.889796 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-edac706e-7a31-4568-90e2-94fcbd1aa95d tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1575 microversion: 2.1 time: 0.166218 Mar 08 14:05:52.890358 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1507/3318] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:52 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:53.907696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:05:53.908231 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:05:53.914520 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:53.914974 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:53.915738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:05:53.916203 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:05:54.047921 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:05:54.055136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-f97147d2-b97e-4038-9dc6-e45b725d3dfd tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1562 microversion: 2.1 time: 0.151433 Mar 08 14:05:54.055696 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1812/3319] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:05:53 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:05:59.902480 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:05:59.903136 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 14:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:07:07.872746 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:07:07.873265 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:07:07.879630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:07.880079 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:07.881609 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:07.881998 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:07.908134 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Going to try to terminate instance {{(pid=117282) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 14:07:07.930307 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-270912ef-8679-40e0-b37f-e1732492cadb req-5d288626-9eaa-4e48-abc3-6b2230ef7967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e0ada3-d209-4230-bc42-c52d5e5ed37f", "tag": "3e589a1d-1176-451a-9700-884f71bb577b"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:07:07.938208 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-270912ef-8679-40e0-b37f-e1732492cadb req-5d288626-9eaa-4e48-abc3-6b2230ef7967 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:07.938654 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-270912ef-8679-40e0-b37f-e1732492cadb req-5d288626-9eaa-4e48-abc3-6b2230ef7967 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:07.950664 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-270912ef-8679-40e0-b37f-e1732492cadb req-5d288626-9eaa-4e48-abc3-6b2230ef7967 service nova] Creating event network-changed:3e589a1d-1176-451a-9700-884f71bb577b for instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f on hv-cinder-83009 Mar 08 14:07:07.957347 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-270912ef-8679-40e0-b37f-e1732492cadb req-5d288626-9eaa-4e48-abc3-6b2230ef7967 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087364 Mar 08 14:07:07.958321 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1813/3320] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:07:08.298474 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-8bfd262c-f768-493b-a6a3-f88581e67074 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "DELETE /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 204 len: 0 microversion: 2.1 time: 0.430596 Mar 08 14:07:08.303766 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1508/3321] 10.222.0.52 () {58 vars in 1238 bytes} [Tue Mar 8 14:07:07 2022] DELETE /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 14:07:08.311003 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:07:08.311796 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:07:08.320950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:08.320950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:08.320950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:08.320950 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:08.467859 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:07:08.478853 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-36e2c7da-c05e-4d49-80ab-5412c659344a tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1568 microversion: 2.1 time: 0.172902 Mar 08 14:07:08.488445 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1814/3322] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:07:08 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:07:09.497997 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:07:09.498601 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:07:09.505139 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:09.505585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:09.507308 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:09.507743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:09.640508 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:07:09.647991 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-9e4476c1-9e67-45b7-ac6e-1f6ad3813628 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1449 microversion: 2.1 time: 0.154275 Mar 08 14:07:09.648545 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1509/3323] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:07:09 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:07:10.379648 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [req-44d81675-bf93-41ad-ba69-026f5f907e8f req-0ad1fe32-1ec3-4e26-a364-0e7c1f5b2e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e0ada3-d209-4230-bc42-c52d5e5ed37f", "name": "network-vif-deleted", "tag": "3e589a1d-1176-451a-9700-884f71bb577b"}]} {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 14:07:10.388022 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-44d81675-bf93-41ad-ba69-026f5f907e8f req-0ad1fe32-1ec3-4e26-a364-0e7c1f5b2e67 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:10.388459 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [req-44d81675-bf93-41ad-ba69-026f5f907e8f req-0ad1fe32-1ec3-4e26-a364-0e7c1f5b2e67 service nova] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:10.399515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.compute.server_external_events [req-44d81675-bf93-41ad-ba69-026f5f907e8f req-0ad1fe32-1ec3-4e26-a364-0e7c1f5b2e67 service nova] Creating event network-vif-deleted:3e589a1d-1176-451a-9700-884f71bb577b for instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f on hv-cinder-83009 Mar 08 14:07:10.404515 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [req-44d81675-bf93-41ad-ba69-026f5f907e8f req-0ad1fe32-1ec3-4e26-a364-0e7c1f5b2e67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080429 Mar 08 14:07:10.405185 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1815/3324] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Mar 8 14:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 14:07:10.665111 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:07:10.665743 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:07:10.672010 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:10.672630 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:10.673432 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:10.673863 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:10.738230 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.policy [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117282) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:07:10.746585 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-c43a4737-86eb-46ac-ad1c-db10d4cc5771 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1220 microversion: 2.1 time: 0.085338 Mar 08 14:07:10.747080 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1510/3325] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:07:10 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 14:07:11.764121 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:07:11.764749 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.compute.api [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117280) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:07:11.771010 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:11.771972 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:11.772745 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:11.773229 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:11.803567 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:11.804014 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG oslo_concurrency.lockutils [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117280) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:11.804502 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.objects.instance [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lazy-loading 'fault' on Instance uuid 73e0ada3-d209-4230-bc42-c52d5e5ed37f {{(pid=117280) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 14:07:11.845378 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.policy [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a82d20d6d26448918d2ecf82e8545c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2b64e03b8c4c5ba1501eb1594b623c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117280) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 14:07:11.852156 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-8e101094-e7ef-488b-bea9-6709711be03f tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 200 len: 1179 microversion: 2.1 time: 0.092768 Mar 08 14:07:11.852738 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1816/3326] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:07:11 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 1179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 14:07:12.869951 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '>' {{(pid=117282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:07:12.870582 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.compute.api [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] [instance: 73e0ada3-d209-4230-bc42-c52d5e5ed37f] Fetching instance by UUID {{(pid=117282) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 14:07:12.877214 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:12.877719 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:12.878626 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 14:07:12.879067 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG oslo_concurrency.lockutils [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Lock "5b93ebe6-7227-4cf2-85fc-4a30a39b2f72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 14:07:12.892140 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.wsgi [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] HTTP exception thrown: Instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f could not be found. Mar 08 14:07:12.892758 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: DEBUG nova.api.openstack.wsgi [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Returning 404 to user: Instance 73e0ada3-d209-4230-bc42-c52d5e5ed37f could not be found. {{(pid=117282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 14:07:12.893573 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO nova.api.openstack.requestlog [None req-e1534481-1681-4137-85f1-7a14d8075402 tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f" status: 404 len: 111 microversion: 2.1 time: 0.028257 Mar 08 14:07:12.894162 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: [pid: 117282|app: 0|req: 1511/3327] 10.222.0.52 () {58 vars in 1235 bytes} [Tue Mar 8 14:07:12 2022] GET /compute/v2.1/servers/73e0ada3-d209-4230-bc42-c52d5e5ed37f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 14:07:13.151891 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: DEBUG nova.api.openstack.wsgi [None req-e618046b-bd12-4566-aea4-e98bb8c28eba tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] Calling method '.version_select at 0x7f5e31d9bd30>' {{(pid=117280) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 14:07:13.239896 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO nova.api.openstack.requestlog [None req-e618046b-bd12-4566-aea4-e98bb8c28eba tempest-TestShelveInstance-1475270913 tempest-TestShelveInstance-1475270913-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1877359331" status: 202 len: 0 microversion: 2.1 time: 0.092359 Mar 08 14:07:13.240471 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: [pid: 117280|app: 0|req: 1817/3328] 10.222.0.52 () {58 vars in 1253 bytes} [Tue Mar 8 14:07:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1877359331 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 14:08:55.537301 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:08:55.537965 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 14:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:09:09.318390 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:09:09.318914 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 14:09:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:10:46.837329 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:10:46.838041 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 14:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:12:15.545543 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:12:15.546094 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 14:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:12:22.760163 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:12:22.760845 dv-cinder-830091-2-iscsi devstack@n-api.service[117280]: Tue Mar 8 14:12:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:12:29.328177 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:12:29.328770 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 14:12:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 14:12:32.042245 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 14:12:32.042970 dv-cinder-830091-2-iscsi devstack@n-api.service[117282]: Tue Mar 8 14:12:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!